The paradox of tolerance applies to speech too. In a society with free speech not all speech can be tolerated, these that oppose free speech should be censored. It is similar to the idea that the GPL is based on.

> is clearly good for one group of people and terrible for a very large group of other people

That was the case for abolishing slavery too.