Tales - a block tolerant web scraper that runs on top of aws and rackspace (github.com) 3 points by calufa 13y ago ↗ HN
[–] rachelbythebay 13y ago ↗ >> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).And people wonder why the AWS machines get filtered. [–] calufa 13y ago ↗ this is why jcoulds will be supported soon. [–] rachelbythebay 13y ago ↗ And people will wonder why the jclouds machines get filtered.It's not the "where". It's the "what". [–] calufa 13y ago ↗ I am just enabling. For me it's not the "what". Its the "who".
[–] calufa 13y ago ↗ this is why jcoulds will be supported soon. [–] rachelbythebay 13y ago ↗ And people will wonder why the jclouds machines get filtered.It's not the "where". It's the "what". [–] calufa 13y ago ↗ I am just enabling. For me it's not the "what". Its the "who".
[–] rachelbythebay 13y ago ↗ And people will wonder why the jclouds machines get filtered.It's not the "where". It's the "what". [–] calufa 13y ago ↗ I am just enabling. For me it's not the "what". Its the "who".
4 comments
[ 6.8 ms ] story [ 23.2 ms ] threadAnd people wonder why the AWS machines get filtered.
It's not the "where". It's the "what".