Common Crawl code contest - with fresh crawl of 3.2 billion web pages (commoncrawl.org) 23 points by Aloisius 13y ago ↗ HN
[–] bashorama 13y ago ↗ Where does it say they have 3.2 billion pages of fresh data? [–] Aloisius 13y ago ↗ It is the 2012 data release linked from the first paragraph. [–] trojancjs 13y ago ↗ This is Chris from Common Crawl. You are right - we didn't have stats about the latest crawl posted. We're putting them up today ... [–] Joyfield 13y ago ↗ Would it be possible to get a torrent with the text only part?
[–] trojancjs 13y ago ↗ This is Chris from Common Crawl. You are right - we didn't have stats about the latest crawl posted. We're putting them up today ... [–] Joyfield 13y ago ↗ Would it be possible to get a torrent with the text only part?
5 comments
[ 5.2 ms ] story [ 300 ms ] thread