My mum had a relationship with a man who was 27 when she was 43. They stayed together for two years, but in the end they split because of the age thing.
It wasn't an issue to either of them in a physical, mental or emtional way asuch, but this guy hadn't had children, and although said he had never planned any - my mum was certain that she didn't want anymore (I was 19/20 when they began going out, and my brother was about 14/15) and would never want to get married again. I think she felt that she couldn't live with her self if he had gotten to 40 or 50 and wished that he had had his own children / got married, etc. It hurts her even now and they split about 3 years ago. I think they should have stuck it out for longer; they made a good couple, but I think mum always felt the end was inevitable and so ended it. From my point of view, if they had stayed together for the next 100 years and then he had regrets about having children, as long as it was something they had discussed and would have been aware of then she would have no reason to have blamed herself.
If you are both sure of your feelings, and make eachother happy there should be nothing to stop you from being together. Best of luck x x