What seem to shout out from your posting - is your resentment that you are the bread winner when perhaps you feel he should be...... do you feel that he has the easier option, or that he is with the baby and you aren't.............. whatever the reason, it screams of unfairness you feel.......
Without knowing your personal circumstances, I wonder If you could have considered managing on his wages even if they would have been lower than yours...........or could you both have worked part time and managed.
I wondered how much of a discussion did you have together about the various alternatives............... before it was agreed that you worked full time and he became a house husband
Also has it changed I wonder , what you feel about him as a friend, husband, lover and life partner................
There are so many questions I would love to ask !!!
About earning power ? Income needs ? confidence - ie as he lost his.?
One comment you make " ......work may expect me to work just as hard just in less day MY PROBLEM NOT HIS" ......I find this comment full of barely hidden anger..........because of course it is not just your problem, not if you became more stressed by having to work harder and that came home, he might if you looked at it without anger ..............be worried about that, perhaps he can sense your dissatisfaction but not know how to solve it.............. a little weak perhaps but perhaps being at home as made him loose his sense of self ....a charge a lot of stay at home mums mention also.
Perhaps you both need a few Relate sessions to enable you to talk to each other ???
Good luck xx