The NHS website seems to disagree with the opinion you were given by your GP (unless, of course, there are particular factors that apply to you and not to most other women).
Quote:
"The benefits of HRT usually outweigh the risks for most women.
The risks are usually very small, and depend on the type of HRT you take, how long you take it and your own health risks.
Speak to a GP if you're thinking about starting HRT or you're already taking it, and you're worried about any risks".
Source:
https://www.nhs.uk/conditions/hormone-replacement-therapy-hrt/risks/
I'm using women's HRT patches myself. (I know it seems odd, as I'm male, but it's a medical trial for the treatment of prostate cancer). From my own point of view, I see the reduced risk of osteoporosis that comes with using them as a positive thing and I've no real worries about any potential negative effects from them.