Maybe they think you don't want to be around them and that you're making excuses not to see them. Try and see it from their point of view - every time they ask you to do something you say you have other plans, including when your friend invited you round and you said you couldn't, but you could go to someone else's. Yes, you have genuine reasons for it all, but maybe they think you are just making excuses. You should also weigh up what is more important - your friends, or rugby. It's not so much about what they are doing and whether or not it interests you, but about being there and spending time with them. Nothing gets my back up more than a friend who claims to want to see me but refuses to make time or sacrifice anything for that to happen. Maybe you could go to the rugby every other week and make time from your friends the rest of the time. They'll get tired of it eventually and stop trying to include you - there comes a point where it's just humiliating to be turned down all the time.