For me, it depends upon the circumstances. For example, if someone bumps into me in a pub and says "Sorry, mate", I appreciate his apology and I'm not in the least bothered that a total stranger has addressed me as 'mate'. But if I'm talking to someone in a customer service role (e.g. a hotel receptionist), who greets me with "Yes, mate?" I want to strangle his employer (not him) for failing to provide the employee with proper training.
Sometimes, of course, the use of 'pet' names can be a local thing. When I lived in Sheffield, both male and female bus drivers would address all of their customers (of either gender) as 'luv'. People who lived in Sheffield thought nothing of it but I've known plenty of visiting men to be 'put out' by another man addressing them in that way.
Me? I tend to address people whom I bump into (for example) as 'guv' or (more usually) 'squire' if they're male. (e.g. "Oops, sorry squire. I didn't see you there"). If they're female I'll call them 'love'. (However when I'm interviewing members of the public I'll always stick to 'sir' and 'madam').