Exactly. As long as there is no ill intent, why do these people care what you or I say. I mean much worse has been said, and if someone is truly racist/homophobic/sexist/whatever I missed, let them speak, because if you listen, you're more likely to find the route of the problem and help.
But, SJW's don't want to help. They're like a catholic priest, jumping over each other to prove who is the most holy and slandering those who they deem lesser, while simultaneously ignoring the people they actually claim to be helping.