Whether you can be charged or not depends on the terms. If the right is granted by an easement it can include a commitment to make payments - e.g. for upkeep of the way.
However, if this right has been exercised without payment for many years it is highly unlikely that such a commitment exists.