They're supposed to be pressed in like buttons mate, not taken off!!Push the line towards the filter firmly to release the tension on the clip, then push it in until you hear or feel a little click, the line should then pull off.
Maybe the person before tried levering one off. Some are a pain though! I did 2 in about 30 seconds and the last one took 30 mins and fuel in my eye!