Those who want the benefit of the social contract without adhering to it will be dominant as they have an upperhand.

No, the intolerant won't be dominant, because they will require everyone to follow them to have that power, and they won't be followed.

The false premise doesn't match the reality 'on the ground'.