How else should it work?
Should investors give funding to people who haven't built anything, whose startups don't have any users, who had bad test scores and did poorly in school, and who have no references? If you think so, why? And how is that fair?
If you believe that, should professional sports teams draft mediocre players? Players who didn't play in college or even in high school? Players who didn't make the JV team? If so, why? If not, why not, and how exactly is that so different?
We all know there is no such thing as a perfect meritocracy. There never will be. Things will never be perfectly fair. That's life. But we can try to come as close as we can. And that obviously requires offering more opportunities to people who perform the best. Otherwise, what incentive is there to even strive and try to do well? The alternative isn't fairness, it's randomness.
Look, if you think people who go to elite schools have all the good ideas, just say that. You don't have to wrap it up in high-minded pragmatism.
This is very obviously not what the person you responded to was saying. It's so far off that it's hard to believe you are even arguing in good faith anymore...