I know that "tortoise-shell" cats can only be female, but I have never heard of orange cats only being male.
The reason tortoise-shell cats are always female is basically because of the X chromosome. In the nucleus of every cell of every animal, along with the chromosomes that control what species you are and exactly what makes you how you are, there is one pair of slightly different chromosomes. In females, this pair is much like all the others, and consists of two same-length "X" chromosomes. In males, there is one X and a shorter "Y" chromosome.
Because the Y chromosome is shorter it is missing many of the alleles (variations of a gene, e.g. blue eyes / brown eyes are different alleles but are variations of the eye colour gene) that are present on the X. A fur colour gene in cats is located on a part of the X chromosome that the Y chromosome does not have a matching half for. (E.g. if the fur colour gene was on the nail of your middle finger, the Y chromosome would be your little finger.)
There are such things as dominant and recessive alleles. Usually, a dominant allele masks the effect of a recessive one (so if you inherit a dominant hair colour allele with a recessive one, only the dominant one will be your hair colour. E.g. D for brown hair is dominant over d for ginger. If you inherit Dd or dD or DD, you will have brown hair.) Some alleles are co-dominant, that is, neither masks the effect of the other and you in fact get a mixture of both. A fur colour gene in cats has two co-dominant alleles.
Female black or orange cats simply have a fur colour allele on each X chromosome. Males only have one X chromosome and therefore one fur colour allele. I will use:
B = black fur
b = orange fur