This is not something that I find troubling at all. If anything, it adds to the overall flavour of the Olympics, is interesting in trying to recall my schoolboy french, and I had always remembered the Olympics being in French then English.
It doesn't harm anyone and I had always assumed that French was the official language of the games anyway.....
So what about William Penny Brookes? And to be honest the announcer had such an 'English' accent when announcing in French it made a mockery of it especially when he said things like 'Royal Air Force'!