There's a difference between being allowed to say certain things, and being allowed to say such things free from criticism. I think a lot of people miss this subtlety. Freedom of speech means that one should, in principle, be free to say whatever one likes. But, equally, people should then be free to counter what others say if it's perceived to be offensive. This doesn't curtail freedom of speech, if done properly. No-one has been stopped from saying what they like, everyone has said what they want to.
Ideally the conversation would over time involve so that fewer people feel a need to say things that are blatantly offensive or prejudiced or otherwise show a lack of imagination, but that should happen naturally rather than by censorship. Still, censorship and criticism are very different things and shouldn't be confused with each other.