Sounds like so many modern men, they want the sex without the committment. If he genuinely feels this way, then you are just wasting your time.
Your situation could drag on for years, with you living in hope that it will be a real relationship, then at some point, he will up and leave.
He really needs to be honest with you and if he doesn't see you as a serious partner, then he should do the right thing and let you go, so you can meet someone who wants the same things as you.