There is some small amount of evidence claiming to show that more boys are born immediately after their fathers come home from war than at other times. This is taken to mean that the ex-soldiers had been making up ( probably rather hastily ) for being s-x-starved. It is also suggested that sperm carrying a Y chromosome swim faster that those carrying X, so the faster ones are likely to reach the egg sooner. More leisurely time spent in bed results in slower sperm ( i.e. those carrying X chromosomes) reaching the eggs later on in their travels down the female tract.
So, if you want to suggest that the original idea might be true, you have to imagine the more attractive people having more time to spend in bed, and less need to be hasty.
Or something.
NB there is not a shred of proof of any of that, but the speculations have appeared in the medical press.