When I first met my wife back in 1994 I was 18 (and still at school!). She was 21 and nearly finishing university. We met in a nightclub so it wasn't obvious to either of us how old the other was which might be a bit different to your situation. But we have been together for nearly 12 years now and so I would say that age doesn't really matter and you just never know how things will turn out.
As 'the older woman' (and you are probably not thinking anyway near this far ahead yet) I would say (as a man) that there are some things to consider in the long term: for example, among my group of male friends I am the first to get married and have kids because of my wifes age - only a few years older for sure but all her friends are married with kids to men in their mid-to-late 30's and so it can all seem a bit 'rush rush' for a younger man later on in the relationship. Just a thought.