Im so sorry to read this. There are times I absolutely HATE money and what it does to people.
I'd let him stew, he needs time to think about what he's said, why, and the effect it will have on your relationship. Stick with your plans...it sounds as if he made no attempt to stop you changing the plans. If that's the case he has no right to get all supercritical now. He had a chance and stuffed it. Make your plans with your mother, and enjoy doing so. At this rate, the other, already planned holidays may be taken without him also...