Hi Halsu, Has your cat changed in any other of their behaviour patterns? ie not eating, drinking, losing weight, not going outside, or making a 'mess' inside?
If so, then yes - a quick trips to the vet for a check up.
If it helps, my adult cat will not come near my OH for about 6 months about this time of year. The reason? OH starts wearing a bigger jacket (padded feather/ down jacket) and for some reason she absolutely hates it. Your cat may have come across someone of the same stature as your husband recently who was a bit mean to it or shouted at it whilst it was playing outside, and so has out your cat on edge when your husband is about. Perhaps try a herbal fragrance plug-in such as 'Feliway' (Pets at home do a cheaper version. And/ or get your husband to feed the cat, both main dinners and treats - so as to reinforce a positive action when your hubby is near the cat. Ask him to soften his voice slightly for the next few days when the cat is around also in case it has had a fright.
Providing there are no medical issues, it really could be as simple as your husband dropping something in the kitchen with a bang a few days ago and the cat all of a sudden relating the loud noise to your husbands presence, so be patient and ask hubby to take the softly-softly approach when near the cat for a bit. Be patient, and of course please do have a trip to the vet if you are at all concerned.
Good luck
Peas xx