Most covenants on properties are widely ignored. For example, no house on the estate where I live is permitted to have an external TV aerial but they all have. Similarly, all front gardens must be 'laid mainly to lawn' but the vast majority of them have been paved over to provide car parking spaces. The covenants here are in favour of the property developers, Barratt Homes, who clearly have no interest whatsoever in enforcing them (as it's half a century since they built the estate), so they can be freely ignored.
The covenant on your property might be similarly unenforceable, particularly if it was created many years ago. So you might be free to ignore it anyway.