Yes, people do say. "Nor me", but it is generally incorrect in that it should be, "Nor I." It depends, as always, on the context.
In my earlier example above..."Well I won't do it"..."Nor (will) I"...the 'will' is optional but the 'I' is compulsory and 'me' just won't do. That's if you want to be grammatically correct by using the nominative case as required.
However, if the situation involved the objective/accusative case, 'me' would be fine. For example, if the first speaker said. "Well, he didn't cheat me", the second would be correct to say. "Nor me."
As I already said, in common everyday speech the "Me neither" version would almost certainly be used. It all depends, Toleman, whether you want the 'correct' answer or the one most people actually 'use'!