You're right Cider. It can't be removed as it's a feature of the phone to prevent accidental numbers being pressed or cutting you off when the phone is pressed to your ear during a call. It also prevents you accidentally dialling a number if the phone is pressed in your pocket or bag.
At least you now know. You will get used to it over time.