> expertise claimed by the author
replyThe author is on record as trying to remove HTTP 418 "I'm a teapot" support from NodeJS, which resulted in backlash and Python adding support for it.
https://en.wikipedia.org/wiki/Hyper_Text_Coffee_Pot_Control_...
Wow. Talk about a storm in a teapot...
replyBack in 2018 when the internet wasn't completely fun, but still more fun than today...
replyNot many people could have gotten that done. Sounds like expertise to me.
replyThe point of the post was that you need to add robots.txt (or similar) because it's a thing, and also tell us where they are.
reply> add a robots.txt
replyWhich bots will then ignore.