I have never had a problem with it getting in the way.

I do prefer the handle that some cars use - as my last several cars had this. I am trying to get used to the pedal emergency brake again