I totally agree with Bobbisox. Your house, your rules. Take no notice of anybody hurling abuse at you. I imagine they will turn down your invitation. That's their privilege. But there is no doubt that there are some places and events where it is simply not appropriate to include babies and small children. Unfortunately many parents, who obviously idolise their children, think they can do no harm and they denounce anybody who does not want to run the risk of their event being spoiled. Tough luck.