I don't think it's really down to him, people are often wired differently. It can be very hard to reconcile this big difference in a relationship.
Say a relationship is something where people find 'love' together, most would agree with that: but the problem is, he may only think you really 'love' him if you have a lot of sex with him. You may see it as other things.
'Sex' needs to be defined too. Do you dislike the amount of sexual intercourse he wants, or is it just the penetrative sex he wants so much that you don't?
Finally, and most importantly, someone that says you owe it to him, just that one thing, because of all the stuff he does for you, is what Psychologists call 'A 'w"nker'. Dump the pr''k. lol.
For me, this would be a hard situation in a relationship. I am highly sexed. lol.