Not using JavaScript would also make the crawler fail on squarespace and wix website builders.
replyThe age where the web was usable at all without JavaScript is long gone. No scraper would get much scraping done without JavaScript these days.
You mean by embedding? How can an external site fail on squarespace and wix website builders?
replyA crawler would fail on all Squarespace and Wix sites if they all require JavaScript.
replyany serious scraping service these days will fail over to a headless browser when it fetches an asset referencing a js bundle that isn't verifiably a vendor script
replyI'm aware and will implement SSR soon ;)
replyIt's entirely possible they simply ingest the JS as-is.
reply