If your A/C is switched off (A/C light off in later cars / ECON light on in earlier cars) then none of your radiator fans should be running when the engine is cold.
I believe the mk5 is prone to the coolant temperature sensor failing, which may fool the system into bringing the fan on, possibly this is your problem?