Not at all, the danger just may be, if your or your partners parents were cousins also, but I don't think you have anything to worry about.
I actually know a couple who are first cousins, and the husbands parents were first cousins,
Yje danger there would be much greater, but none of the children had any problems at all.