Where is this office ? If it is in the middle of a town or city near a major road. you may be better off with the window shut. Traffic produces invisible particulates, contaminating the air, which could enter the office via the window, and thence your lungs. And everyone else's.
So you should ask yourself - how fresh is that air ? being cold doesn't mean it is "fresh" or "clean". It may actually be filthy.