Covenants & Restrictions

[saz1]

My neighbour has erected a fence along the boundary between our properties in contravention of the Covenants and restrictions detailed in the deeds to all properties on our development. It says "Not to keep place or erect any building structure fence hedge or wall or other erection whatsoever in front of the frontage line of the buildings erected on the property" Am I in my rights to ask him to remove this and if he refuses can I take legal action?