One doesn't have an automatic right to use another person's drive, but if all they use is the dropped kerb & pavement area it's difficult to get too uptight, as one would hope all neighbours were happy to help one another. If they are actually driving onto your property that is rather out of order though: and the nearby road does make it a bit of a cheek anyway.
Probably one of those things one is better off trying to not get peeved over though. It's not going to get better by feeling bad about it, that just messes you up inside.