Did you change the DV? If you did was it split? I think you have a smallish split in the DV that, when cold, is managing to maintain roughly the boost required. Then, when hot, the rubber gets more malleable and therefor lets through more air. Even if you've checked the DV and thought that it's fine don't put it back in, just replace it and see if it's cured - eventually you'll need to replace it anyway as they are a weak point.
I changed mine to a revision D DV, the metal one that was mainly used on audi at the time I believe, as it didn't have the wide rubber diaphragm that is/was susceptible to ripping.
These engines are noisy, for mine it's mainly the injectors, but if it sound like a diesel then it's possible the cam chain has stretched and needs replacing at some point.