Personal headphones is the only answer! Otherwise you'll either have to out boss each other or come to some "your turn, my turn" agreement.
Personally I can't stand the TV too loud and when it is and i'm not bothered about the programme, I put my headphones on and listen to the radio on the internet whilst chatting on here.