Its an old saying that impies only thicko�s and animals would actually do physical work for a living, whereas an intelligent person would find clever ways of making money without doing much hard grafting. It predates the programme.
It certainly predates the programme because series writer John Sullivan had previously used that title for an episode of an earlier series he had written, namely "Citizen Smith"...