[–] alecsmart1 12y ago ↗ The title is misleading. It should be "Lessons learned about web crawlers while crawling the web" [–] jgmmo 12y ago ↗ I think it should be called 'web scraping 101'Very thin article. [–] billrobertson42 12y ago ↗ I found certain aspects of it really interesting. In particular, the way that the author interacts with the crawling software to gain insight into the structure of a website. Not just the process, but the way he interacts with it is interesting too.
[–] jgmmo 12y ago ↗ I think it should be called 'web scraping 101'Very thin article. [–] billrobertson42 12y ago ↗ I found certain aspects of it really interesting. In particular, the way that the author interacts with the crawling software to gain insight into the structure of a website. Not just the process, but the way he interacts with it is interesting too.
[–] billrobertson42 12y ago ↗ I found certain aspects of it really interesting. In particular, the way that the author interacts with the crawling software to gain insight into the structure of a website. Not just the process, but the way he interacts with it is interesting too.
3 comments
[ 4.3 ms ] story [ 22.8 ms ] threadVery thin article.