Reputation is as harmful as it is good. Anyone who survived being unpopular in high school, or seen the dummies that can be elected in democracies, should be able to explain how.
No, it is better to judge works by their merits than it is to judge people by their popularity. Though it is far more expensive.
But your points largely stands. However, reputation is one of many tools that can be used to assess the worthiness of giving some work attention, but should be given a relatively low weight compared to other tools. Giving reputation a low, but non-zero weight allows bad actors to be rightfully put in their place and allows someone the ability and chance to "clean up" their reputation with effort.
My core idea (back in the early 00's when I cam up with it originally) was to identify a small cadre of trustworthy individuals in various sectors - lets say finance, computing, healthcare, etc (but more granular) and give them high trust (maybe a manual score of 10). Then let who they score, and who those people score "trickle down" as it does in Googles page rank. It was a variation on what Google later called trust rank, I suppose.
It would have either failed to launch completely or turned into a dystopian nightmare akin to China's Social Credit System. It may have even turned out worse than China's system because the goals of finance do not always align with the goals of humanity.
A more modern implementation could be built on the block chain and be made very profitable... while it crushes us all.
PS: I'm not talking about fake "honor" based power systems.