This is one problem Burnley does not have.
Seriously though, is this really just a holiday home issue? eg look around the central parts of London - rich people buy up swathes and the cleaners have to spend valuable wages travelling in......seems to be the same now with all the large cities.
Maybe the actual cause of the misery is over-inflation of property prices and soaring rents. After all, if you knew you can get a quarter of a million for a run-down house on a bit of land in the south west, would you really resist? Or would you take the money and retire to a convenient modern flat, perhaps in Benidorm?