It may refer to a saying of William Morris ( artist, designer, poet, printer). He said that you should have nothing in your house unless you know it to be useful, or believe it to be beautiful.
I've grown up hearing and saying that, usually to someone trying to do a job but failing miserably. e.g.
'get out the way you're neither use ner ornament let me do it'