I mean, who cares if people can band together to vote a guy out of office if the powers that be control his replacement?

Voting isn't any different than non-voting if it can't bring about real change for the better.