It's never too late to learn! Well OK, you might be pushing it a bit if you're looking for a place in the London Philharmonic, but if it's just for recreational or amateur performance reasons, you'll be fine. One of my New Year's resolutions is going to be to learn a musical instrument (I'm 39), but I haven't decided which one yet (it won't be piano, my flat isn't big enough!)
Anyway, I think the clarinet is a lovely sounding instrument, and very versatile as it is equally at home in both jazz and classical music. Good luck in your endeavours.