But how can you be required to follow the terms of a contract you've never signed?

This seems flawed, you just have to find my opinions intolerant, and you throw away your own «tolerance».

True, but nobody made me or you sign any sort of agreement to act and speak a certain manner. Furthermore, how could such a social contract even be binding if people don't implicitly agree to it either?