(And sometimes just leaving really is the best step!)
A vote would in turn provide a mechanism to prevent such abuse. The boss works for the people not for their boss. Likewise the boss is no longer bound to the whims of their own boss. Their boss is the people below them. A group they will inevitably rejoin with new found appreciation for the troubles of management.