You're only 30 and not even considered in your prime yet, MM........
What you got to answer to yourself is " Is this going to lead to anything in the future" Is he just using me for sex?"
How will your children take to him when and if they do ever meet?
How will he treat your children?
Are you smitten by him as he is younger and gorgeous as you mention?
Why did he mention that he and his ex had sex 3-4 times a day? and did that pressure you to continue with that, even though you say that, at the moment, once a week will make you happier?
You say you dont deny him.......Does that mean you have sex with him, even when you really dont fancy it?
Sorry to a bit blunt, MM...but these are the facts as I see it......and its up to you, and only you, to see where you go from here. You know deep down how you feel.
I wish you all the very best, my lovely :) x