Depends a bit on the age of the car, if it is getting on a bit I would start checking things like the steering ball joints and the suspension ball joints and maybe even the engine mountings. These are all things which would effect the steering with the torque change when the gears change.