Maybe he's just shy? I can't say I agree with Sqad's opinion because at one level the way this man is behaving is similar to the way I would, trying to take things slowly and carefully. But given that he's invited you in to his house for a drink and seems to keep wanting to see you, I can't imagine him not being very interested!
If you are going to ask him if he sees other people... well, I wouldn't put it like that. I'd be inclined to keep any conversation like that focused on you and him, and ask him what he's looking for and so on. And, for that matter, ask yourself what you are looking for. My gut feeling is that despite all your suspicions you like him. And my other gut feeling is that those suspicions have no basis whatever except for what Sqad's saying.
Anyway, choose whose advice you take, but if you're wanting this man to come on a bit faster then you might be waiting a while, perhaps he's not like that. So I guess that means that, one way or another, the next move is yours to make.