Authority (CAA) sets the rules on drones in the UK under what is called an air navigation order.
An unmanned aircraft must never be flown beyond the normal unaided "line of sight" of the person operating it - this is generally measured as 500m (1,640ft)horizontally or 400ft (122m) vertically
An unmanned aircraft fitted with a camera must always be flown at least 50m (164ft) distance away from a person, vehicle, building or structure
An unmanned aircraft fitted with a camera must not be flown within 150m (492ft) of a congested area or large group of people, such as a sporting event or concert
For commercial purposes, operators must have permission to fly a drone from the CAA
In the US, the Federal Aviation Administration bans the flying of unmanned aircraft, including hobby drones, above 400ft.
The FAA also states that, if they are to be used within five miles of an airport, its air traffic control tower should be notified in advance. They should not weigh more than 55lbs (25kg).
It is probably time for some prosecutions to make those rules known by the general public.