A plumber was recently out at my house and was able to remove very stubborn pen marks on tiles with what he described as his 'magic rubber'.
It was basically like a rubber / eraser but looked porous and as it was rubbing out the marks it wore away as dust. It actually reminded me of the grey coloured gritty rubbers that were available about twenty years ago for rubbing out pen.