Web Scraping Is a Commodity (blog.databoutique.com)

Definition: There is no intrinsic value difference on who is doing it, as long as it's done well.

I hope that commercial web scraping gets centralized enough so only a few companies do it. It would make it that much easier to block.

sounded great but the data sample data format is this https://s3.eu-central-1.amazonaws.com/databoutique.com/publi...

i don't like the structure, also this data quickly goes out of date, however it would be useful for grabbing a snapshot of a store site at a given time