Write yourself a list of gains and losses. You can be free, or tied to a lazy demanding bully.
Alright, you lose some money, but with your caring background, you'd easily get a job in a care home at the very least. You might even get a live-in job as a housekeeper somewhere. Some boarding schools have such jobs, and they prefer mature women. You'll gain by having more fun ( you could hardly be having less, could you ?) getting to know more people, opening up your horizons. You won't have his company, but that's a bonus, not a disadvantage.
Stop being a doormat
Time to go