Ask HN: Do you scrape? 4 points by tehwebguy 10y ago ↗ HN Do you scrape anything?If so, what and for what purpose?What software or service do you prefer?
[–] ashitlerferad 10y ago ↗ Absolutely, the web is such a horrid place that scraping is a necessity. [–] tehwebguy 10y ago ↗ You scrape as an alternative to browsing in some cases? That's interesting, is it to avoid advertising / tracking / poor UI / something else?
[–] tehwebguy 10y ago ↗ You scrape as an alternative to browsing in some cases? That's interesting, is it to avoid advertising / tracking / poor UI / something else?
[–] pink_dinner 10y ago ↗ Write your own. For me, it's the most efficient (and you will learn a lot).
[–] snehesht 10y ago ↗ Writing your own may take some time but it's definitely worth it.I use Python + AsyncIO + lxml. If you're are new to this and don't have time to learn new things, I suggest you try import.io
5 comments
[ 3.1 ms ] story [ 21.0 ms ] threadI use Python + AsyncIO + lxml. If you're are new to this and don't have time to learn new things, I suggest you try import.io