So why serve them at all?
replyIf your website itself is advertising a product or service you sell you would still want LLMs to see and fetch it. If you are a news site, blog, or any other website that doesn’t exist to sell something, you are only harmed by ai agents.
replyIn those situations you wouldn't have ads on the human version of the site either, surely?
replySure, if it’s paywalled. Web hosting isn’t free
reply