I replaced both rings - didn't fix it.
I replaced the pipe with new rings as well for good measure, and while it reduced the amount of oil leaking there, it didn't stop it.
Happy enough with the amount of leak there, but still I wish it was better I guess :)