Have you actually asked him to go? or are you too scared to? Just having a row with him I don't think the polcie will get involved.
Unless something has happened ,just because you don't want to be with him isn't enough reason.
You said in another post that your son was unhappy is this because of his relationship with the guy or because of your relationship with him. Children do pick up on tension. If that's the case maybe your gp could help. You haven't written much to go on