upvote
Yet you can be absolutely sure that Google is training their AI products on the same pages they do not want to show to their search users.
reply
Have you added a robots.txt and a sitemap.xml, even an RSS file?

While I don't know if this will help with Google, I have my own tiny dumb search indexer, and a sitemap is by far the easiest way for me to index an entire website. I'll discover the sitemap from reading your robots.txt file. RSS helps too, but my indexer uses that mostly to find fresh pages without going through your entire sitemap again. I know Kagi's tiny Teclis indexer also uses RSS files for discovery for their indie web index.

reply
> Way to help your users

Dear Jim,

At Google, our intent is to help our stockholders, not our users.

Sincerely,

Alphabet inc.

reply
That's every company
reply
It’s not every company having the effective monopoly on what can be found (i.e. what exists) on the web.
reply