I have essentially this at work, but the scrapers ignore it. (Or at least many, many scrapers ignore it.)
replythat's hard to do with rendered content, oftentimes the result depends on a backend service. Maybe you should make the service it's running public but that might be a line most aren't willing to cross.
replyI was thinking you scrape your own website every day in the middle of the night when traffic is low, and make that available. They can come and collect it every day if they want to.
replyYeah. Though I guess the point I thought of was like a deals site. That would have infinite pages and content
reply