I sure can, and it's the bane of my life too. It's to do with cheap manufacturing. If you know anything about dressmaking you will be aware that fabric has a "grain" and that pattern pieces are usually cut out on the straight of the grain of the fabric (ie. parallel to the edges). In cheap manufacture they use a computer to place the pattern pieces in whatever way necessary to get maximum number of pieces out of one piece of cloth. This means they are often cut on the bias (or on the skew, to you!) This doesn't matter quite so much until the garment is washed, and considering front and back of garment could be completely different in direction the result is that the fibres pull against each other, rebel and "twist". Voila. As you say it's not just cheap clothes that do it. It's bad manufacture. You will also find that hemlines and sleeve edges won't lay flat for the same reason.
PS if you find any decent T-shirts that don't twist, please let me know!!!