sometimes the tyres can grain and develope a stance pattern from your car and the way you drive it and weight distribution (think of wearing in some comfortable shoes that mould to your feet over time)
swapping the wheels upset that graining/wear pattern so the rubber is going to make a argument until theyre worn in again in the correct shape
hopefully that made sense, not always the case, but pretty common when swapping wheels around from front to back