Finally someone pointed it out!
Indeed it is a major issue about car handling, and makes the whole experience really annoying and unrealistic.
I would also like to see some improvement about this in A3 since I'm also using sometimes mouse for driving.
Thanks for the idea Jonny!