Funny you should ask that. Someone at work yesterday questioned the same thing when a crime was being discussed on the radio and it said there was a third party involved. Couldn't work out why they were called the third party and not the secon party.
I wonder the same with floors. Why is it called the first floor - it's the second one.