I've only seen 1 or 2 that know what they're doing. One's at lemmy.world ... just hovering over it is verified ...
Unfortunately, if you let all the bots in, they overwhelm your servers, and then nobody can access the website.
I had some git hosting up for a while, and was serving hundreds of qps and several terabytes per month. I can only imagine want significant sites are serving.