What is your car protected with?
As above, dump the chamois in the bin and get a proper drying towel. The two main types are microfibre and waffleweave. Both have advantages/disadvantages.
After washing, how do you rinse? Ideally you need to sheet the water. This basically means an open ended hose. Secondly, you need to dry quickly. You can use a quick detailer after drying to buff the car. Quite a few people use meguairs last touch. Also, in warmer weather, it can be beneficial to rinse and dry one panel at a time (starting with the roof).