I can appreciate not everyone feels comfortable being affectionate in public, I'm the same and holding hands is as far as I would go.
The thing which stands out in your post is that he tells you there's nothing you can do to turn him on and he will never be overwhelmed with desire for you. From that, I would take that to mean you are just a stop gap until he finds "something better".
The fact he can easily say hurtful things to you and not really be that bothered that you feel hurt, seems to indicate he can take you or leave you and that you are more into him , than he is you.
Where do you see this relationship going? You seem like someone who has alot to give in a relationship, so surely you deserve someone, who will give in return to you. This guy sounds totally one sided and appears to have little respect for you.