Archive.org mostly ignores robots.txt

https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...