Ivy is an excellent late late nectar source for all manor of wasps, hornets and hover flies etc, when there is little else around at this time of year.
Although I react to wasp stings badly, I find that while they're busy collecting nectar, they will be unlikely to bother you, if you don't bother them.
Last time I got stung, it was from a wasp that had become trapped in the house.
If I see a nest around, you won't see me for dust!, that's when they really get protective and go into attack mode.