If it is your brake shoes, which it sounds very much like it is, the shoes will be down to the rivets and it will score the drum, I had to replace the drums on a car once as it had been continually driven with the pads worn down to the rivets and they had massive grooves in them which were impossible to smooth down. The worst scenario is that the spring may have broken which holds the shoes in, and this would cause the brakes to grind, but I would assume that it would bemore of a jerk on the brakes when they are applied. Sorry to be the bearer of bad news but the sooner that the brake shoes are replaced the better and safer for you. John