O level biology was a long time ago, but I seem to remember that a faulty gene that doesn't code for anything sensible is inherently recessive. Lets say
G = good, average gene
B = bad, inherently recessive gene
In a mixed gene pool you may have:
GG + GB --> GG + GB + GG + GB
so 50% of offspring carry the bad gene harmlessly
In the limited gene pool you would see much more occurences of:
GB + GB --> GG + GB + GB + BB
condemning 25% of offspring to have a harmful, quite possibly fatal defect.
Now what happens if you have a super gene. In the mixed gene pool:
SG + GG --> SG + SG + GG + GG
but the S could be dominant or recessive, so only 25% of offspring exhibit the super trait. In the limited gene pool you will get many more:
SG + SG --> SS + SG + SG + GG
so 50% of offspring exhibit the super trait.
Unfortunately there are many more ways to get a B than an S. So, in the limited gene pool you are going to get a lot more offspring with problems than you will get super traits. Hence the reason most of us are programmed (by our genes) to not fancy our own parents, siblings or children.