I shutdown all my little informational hobby projects this year that I've tinkered with for decades
replyThey all shifted from mostly paying for themselves (or being so cheap it didn't matter), to essentially producing zero income while resource usage leapt up in magnitudes
I couldn't justify the stress and hassle of making sites, that a few dozen people a day might find useful, into some complex hyperscalable obligations just to feed the bots
But what do these bots gain from this?
replyIt's all OpenAI / Anthropic / Singapore/China based crawlers. I guess they gain data that I provide for free. I get very little crawling by Googlebot / Bing etc which barely even index my site, I only have a single page "indexed" by Google.
replyPossibly content that appears only briefly? I'm not sure otherwise. It seems wasteful.
replyHave you ever use an AI chatbot? It's basically a democratized scraper.
replyType something stupid, it "visits" 200 websites and regurgitates some random gibberish.
The most recent info of every single fucking thing on the web. Everything. Data locusts.
reply