In 1949, USA president Harry S. Truman is said to have had these words posted up on his table in the Oval Office, implying that he accepted ultimate responsibility.
I'ts a pity the current president doesn't follow suit!
it's a twist on the older phrase about passing the buck - which apparently is poker players' jargon, to do with the dealer holding a knife made of a buck's horn. Full explanation here.