i think you should phone or text him and tell him straight - to bu99er off!!!
give him a piece of your mind so he knows you won't welcome him back, or enjoy the attention, that in fact you will loathe him and may call the police.
what is it with some men that they think barging in and making demands will make you come running back to them?
i would dislike a bloke all the more if he pulled a stunt like this with me, it shows up a plethora of negative traits that would not endear him to me, and in fact i would revel in watching him make a twart out of himself