Chungster, I'm by no means an expert on the Nikon gear as I am a Canon man but there should be a VR Type button: In the Normal position, VR will detect panning and not try to correct for it. In the Active position, VR takes out all motion.
Hope that helps.
Dom