We too have them despite all the seagulls. What we've noticed is that they seem to be quite nervous, you only have to open the back door and they fly away, we tap on window and they go. My opinion is that they hate being startled, so if you startle them repeatedly, they might associate being frightened with your garden and not return. They must have a memory, otherwise they wouldn't return to your food.