Why shouldn't a democraticaliy elected member of a legal political party go along to the Queen's garden party?
After all there have been many invited to the palace, with a much worse character reference than Nick Griffin, Robert Mugabe springs to mind (wasn't he knighted?) along with some members of the main political parties also.