Larry Niven played with this in one of his stories; a time traveller from the far (and highly polluted) future has to use mechanical breathing assistance, because the levels of CO2 in the air in the past weren't high enough to prompt the breathing response properly (human breathing is controlled largely by blood CO2 levels).
Anyway, by your own line of thinking, wouldn't sensitive lungs be an advantage? The incentive to find cleaner air is also breaking away from the pack. Since humans are social creatures, that's more likely to look like new leadership for followers who have their own reasons to break away.
Every civilization in history has started out that way. It takes more than mere brute force to beat the competition. Survival is just as much about picking your battles and working smarter.