Chewing insects (caterpillars and aphids) tend to cause unsightly damage to leaves and foliage, causing premature leaf drop and sticky residue on willow trees.
I'm guessing the caterpillars are your problem.
Pick them off by hand and dispose of them, or spray the tree with pyrethrum or bifenthrin.