communication really is the answer, you both need to sit down and have a talk and try and get to the root of the problem.
He is the only one who can answer your question.
if you don't talk to him,you will just worry yourself sick over it. It may very well have nothing to do with your relationship-but may be something else that is on his mind or troubling him.