No it's not you. It's them.
In simple terms, adding bicarb to vinegar produces a solution of sodium acetate, water with the production of carbon dioxide.
Let's look at these one by one.
The sodium acetate produced doesn't all go into solution despite being very soluble in water. You'll see it as a small amount of white powder in the mixture after the reaction is over. Powders of this type are abrasive to an extent in water.
Water has always been known as the universal solvent and is a powerful cleaning agent in itself.
Unless this the amount of dry bicarb in grams and vinegar in millilitres is calculated very carefully, vinegar may well remain in the final solution. Years ago, laboratory demonstrators used to demonstrate this by getting the students to carefully sniff the top of a beaker after the reaction between the bicarb and vinegar subsided. Invariably, they could still detect a vinegar odour.
So what does this all mean? Well, after the reaction you have a universal solvent, an abrasive powder and another powerful cleaning agent (vinegar) in the resulting solution. You might as well tip salt/fine rock salt/sea salt into water with a few splashes of vinegar for the same effect. Lots of people seem to use these ingredients separately. It's the fact that it fizzes just seems to give the impression that it's powerful. It's not.