3 comments

[ 0.24 ms ] story [ 432 ms ] thread
Hello HN! This is Jan, co-founder of Apify. Web Scraper (apify/web-scraper) is our new actor in Apify Store which aims to be a general-purpose tool for web crawling and scraping. Under the hood, it uses headless Chrome and the data extraction is done using a provided piece of front-end JavaScript code, potentially with the help of libraries such as jQuery.

Please give it a try, it's free. We'd love to hear what you think - both good or bad things :)

do you have any plans to allow to combine it with proxycrawl? That would be great as I could benefit from them while using your tool