'Jeff' has been used to mean 'deaf' for a long time, as in 'Mutt and Jeff' or 'Mutton Jeff'. (So, 'mutton' can mean deaf, too, in rhyming slang.)
Since you use a whole row of excalamation marks, I imagine he is shouting at you...ie suggesting that you are deaf.