no they wont. If youre worried about that then how will you cope when they start education? My son is 3 and he is either with me or his nana, hes grown up thinking it normal and he certainly isnt bothered by watching me go off to work. Even if hes poorly he knows that hes safe with nana and she looks after him very well.
Its your choice if you work or not, but dont feel bad about daddy putting them to bed 3 days a week, chances are they will love it and youll enjoy having just a bit of quiet time away from 2 toddlers.