Common Crawl code contest - with fresh crawl of 3.2 billion web pages (commoncrawl.org) 23 points by Aloisius 14y ago ↗ HN
[–] bashorama 14y ago ↗ Where does it say they have 3.2 billion pages of fresh data? [–] Aloisius 14y ago ↗ It is the 2012 data release linked from the first paragraph. [–] trojancjs 14y ago ↗ This is Chris from Common Crawl. You are right - we didn't have stats about the latest crawl posted. We're putting them up today ... [–] Joyfield 14y ago ↗ Would it be possible to get a torrent with the text only part?
[–] trojancjs 14y ago ↗ This is Chris from Common Crawl. You are right - we didn't have stats about the latest crawl posted. We're putting them up today ... [–] Joyfield 14y ago ↗ Would it be possible to get a torrent with the text only part?
5 comments
[ 3.1 ms ] story [ 21.7 ms ] thread