This is where I do sympathise with men a bit (only a little bit mind).
In this situation, I would very probably feel exactly the way that you do, but is that really fair? Look at it from the (slightly more emotionally limited) perspective of a man brain. You're taking him away for a fantastic paid weekend, mixing romance with football, it doesn't get a lot better for many men. He knows about this and has kept that weekend free. He then either gets told or asked to go away for work on his birthday, and he thinks 'that's ok' because he knows it wont muck-up ChuffingHells plans.... And now he's getting told off, and he's not really sure why.
In an ideal work CH, he'd turn around to work and say, I can't possibly stay away that night because it's my birthday and I want to spend it with the wonderful woman I love.
But life's not that kind to us. So, to conclude, I don't think he's doing anything wrong, get up slightly earlier with him on his birthday and have a lovely breakfast with him, and give him his present then. It's not worth having an argument over.
Have a lovely time x