if a grizzly old bloke can offer a point of view, i think cutting him out of your life for a while might be a good thing, if you can do it.
There's always one partner in a relationship who cares more, and that partner can get used. If he feels you're too easily available, he may do just that.
I notice he said he felt nervous. Could he feel you're coming on to him too much, and threatening whatever setup he has at the moment?
If you could get the idea across that you would like a lasting relationship, but don't want to crowd him, so that you wouldn't communicate again, it may take off the pressure, and allow him to see what really matters to him.
If he's in a relationship, perhaps wait for it to end - he may come running back.
Most blokes don't think about relationships - things have to dawn slowly.