This just isn't true. arXiv nowadays has to deal with major moderation demands due to the influx of absolute drivel, spam, and slop that non-academics and less-than-quality academics have been uploading to the site.
Moderation for arXiv isn't perfect or comprehensive but they put so much work into trying to keep the worst of the content off their site. At this point while they aren't doing full blown peer review, they are putting a lot of work into providing first pass moderation that ensures the content in their academic categories is of at least some level of respectable academic quality.
First pass sanity checks are also a lot less fun than proper peer review so paying moderators to do it is probably safer in the long run or else you end up with cliques of moderators who only keep moderating out of spite/personal vendettas against certain groups or fields.