You're looking in the wrong place, Kloofnek. (You appear to be looking at your email when you should be looking on your hard drive).
Go to My Pictures (or anywhere that you've got some image files on your computer). Right-click on
any of them. Select 'Open With'. You'll probably see Windows Live Photo Gallery listed there but DON'T click on it. Instead click on 'Choose Program'. Click on 'Windows Live Photo Gallery' (to highlight it), PUT A TICK IN THE BOX (where it says 'Always use the selected program to open this kind of file') and then click 'OK'.
In future Windows will always use Windows Live Photo Gallery to open any images on your computer (unless you tell it otherwise by right-clicking and using 'Open with' or by opening your preferred program first and then opening an image directly from it).
PS: You must be unique in liking Windows Live Photo Gallery!
(Irfanview is about a zillion times better:
http://www.irfanview.com/ )