The word does not - despite what most people seem to imagine - have any sort of sexual connotation in this phrase. It first appeared in mid-19th century, using 'care' instead of 'give' and all it meant was 'an iota' or 'a small amount'. Basically, all it means, therefore, is: "I don't care at all."