HN Explorer

Can you search “Common Crawl” on Google with keywords only?

1 points by chauchakching ↗ HN
I didn't expect how hard it was to search it on google. All I got were "top x crawler"/"scrape with 1 click"/"scrapy". Is it bad SEO or something?

1 comment

[ 2.3 ms ] story [ 12.9 ms ] thread
Someone
If you mean https://commoncrawl.org/: of course you can. Grab a few specific words from the page and away you go.

Sample searches:

  an open repository of web crawl data ⇒ first hit
  open web crawl data ⇒ first hit
  free web crawl data ⇒ third hit
it seems “data” is essential here.