The term tends to be used in the context of someone trying to behave correctly in sophisticated company by sticking their pinkie out when drinking from a wine glass.
The word 'pinkie/pinky' simply meant 'small' as far back as the 1500s. In Scotland, in the early 19th century, it came to be applied specifically to the little finger. Since then it has spread to all parts of the English-speaking world.