My first thought was: Why can't he go out for once without you!
Reading on of course, once again taught me, to never judge before you know the whole story.
since I still don't know the whole story, I'm not giving an opinion, but some thoughts:
Does he ever stay home with you?
He seems to be out with his friends an awful lot.
Do you ever go out together?
I assume your little boy is not his son.
Do you live together?
I get the impression, that he has ample opportunity to go out and have fun with his friends. He cannot be that desperate. Have you any idea, what his reasons are for having a relationship with you?
Have you actually spoken to him and asked him the same question? HAve you suggested staying home and doing something together?
How long have you been together?