upvote
except google does respect robots.txt so you do have a choice?
reply
still respects robots.txt
reply
> They have no obligation to respect your wishes

I have no obligation to not send all scraper-looking traffic to a black hole full of zip bombs.

reply
There's always poison fountain - deliberately wrong source code.
reply
Spreading malware to your website's visitors is wild and illegal in most jurisdictions. I certainly wouldn't confess about it online.
reply
Malware? It's just a large file. A very, very large file.

But fine. How about I just...don't respond to those requests at all. I have no obligation to send them data period.

reply
Is AI a visitor or malware? It certainly steals paid resources (bandwidth).

Disclaimer: his website is for hosting malware for "testing" purposes. Testing how well AI can't deal with it.

reply
You do have an obligation because what you are describing is illegal, at least in the US under the CFAA.
reply
Okay, nix the zip bombs. What's my obligation to treat bot-shaped traffic as something I should reply to?
reply