Thats absurd. Physical prowess may help influce others to follow you but outside small tribe level interpersonal relationships simply being the strongest person or best swordsman is hardly the required quality of a leader.

The strongest guy isn't in charge of the kingdom because the queen has an army.