(To be clear, not targeting you personally here, but targeting the rhetoric and fallacy)
If everyone else is defecting and you can cooperate with a few people, that's slightly better for you. Hence we have high-trust and low-trust societies, gatekeeping, etc.