It's not unusual for judges to say something along those lines. They are trying to be helpful. . It sounds as though you are not legally represented. I say that because statements like that are normally made by the lawyer to his or her client, as part of their professional duty to the client . Like doctors , lawyers have to be frank when they advise clients.If the judge sees you have a lawyer present then such judicial comment is unnecessary.
Of course, it's possible that you have the words in a far worse light than they deserve.I do empathise with you but have to say that it is extremely common for the person hearing whatever the judge says to be so emotionally involved that they interpret anything and everything as the plainest indication of bias or hostility. A lawyer would get rich(er) very easily if he had �1 for every time the client said " The judge is against me" !
I can't think that in these circumstances, the judge would debar herself from sitting again on your case. What's more, nobody else will debar the judge and order a change. (If it were that easy then, for the reason I've just given, people would be changing their judge almost every time there was a hearing )