Exactly the same symptoms as mine. It's OK when in boost but the throttle response getting into boost and driving around town is horrible, it's like driving with the handbrake on. It used to pull itself along easily on the motorway and like yours, I also have to drop down a gear just to maintain a constant speed.
I changed the turbo yesterday and it made zero difference. I data logged MAF, boost, lambda, both fuel pumps, VVT, intake temp etc etc over a 30 min drive and absolutely nothing wrong, everything in spec.
The brakes aren't dragging.
I'm at a loss now. My next areas to try are replacing the green boost O-rings as the new turbo is a bit noisier than it should be, and checking the throttle body. Whilst stabbing the pedal with VCDS up, I did notice a quite a bit of delay in the throttle body responding.
Partially plugged cat is another theory I have.
Bloody car
P.S Occasionally mine tries to stall when pulling up to a junction then recovers, and this whole issue is intermittent as well. Some days it's a missile, and some it's a complete slug. The fact it's capable of normal performance, even if temporary, suggests it's mechanically fine. No idea what is going on as logging shows nothing and there's never any fault codes. Tiny long term trims as well, <2%.
I'm nearly at the point of handing it over to a diagnostics place, but if I've fired the parts cannon at it, I'm not sure they'd find anything wrong either