If I were you I would first go and see a solicitor and tell them everything. Then have the locks changed and a letter from said solicitor sent to his work,or wherever - anywhere you will know that he will get it the day the locks are changed.The call the police before he gets home and explain that you have seen a solicitor,changed the locks and are expecting him to still turn up and cause a massive scene.
The bottom line is that it is YOUR house - not his and he doesn't have a leg to stand on. The most he could do is to take you to court for money for things he may have bought in the property.
Let us know how things are going and if you ever want to chat I am on msn.xx
[email protected]