So the solution is to allow the AI scraping and hide the content, with significantly reduced fidelity and accuracy and not in the original representation, in some language model?
replyDon't forget the onslaught of ads that will distort the actual publications even more going forward.
replyWhat has that got to do with blocking AI crawlers?
replyIf it's publicly funded, why shouldn't AI crawlers have access to that data? Presumably those creating the AI crawlers paid taxes that paid for the science.
reply> If it's publicly funded, why shouldn't AI crawlers have access to that data?
replyBecase it costs money to serve them the content.
If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI?
replyIs the answer regulate AI? Yes.
> If I build a business based off of consumption of publicly funded data, and that’s okay, why isn’t it okay for AI?
replyBecause when you build it you aren't, presumably, polling their servers every fifteen minutes for the entire corpus. AI scrapers are currently incredibly impolite.