Ask HN: Where do companies like outpan and semantics3 get their data from? 4 points by joshpen188 8y ago ↗ HN
[–] outpan 8y ago ↗ Outpan here,We use a combination of polite massive-scale web crawling and user contribution. We had an in-house web crawler for years until recently when we released it as a stand-alone service.
1 comment
[ 2.4 ms ] story [ 12.6 ms ] threadWe use a combination of polite massive-scale web crawling and user contribution. We had an in-house web crawler for years until recently when we released it as a stand-alone service.