This is the key principle and mystery of art. In the same way that you as a person are unique, so is the image at which you look. Therefore, it would be impossible to look at something and feel someone else's response. You may empathise and agree that there are certain aspects of the image that are common to everyone, however, your reaction is, and always will be, solely yours.
As for the influences on social perception. Well, one's own opinions may change according to the social situation e.g. the prominence of a religion in society, the strength of the media etc. Basically anything societal influences social perception.