Much appreciated! I'll update my page to link to your much more polished one too :)
I went down the same rabbit hole and did the exact same thing last week in a fit of procrastination. https://news.ycombinator.com/item?id=46185128 Would appreciate a shout-out if you saw it and were inspired, otherwise…
Can't argue with those credentials. Thanks for confirming/clarifying!
I'm not so sure, they say "The crawled content is dominated by HTML pages and contains only a small percentage of other document formats." https://commoncrawl.github.io/cc-crawl-statistics/plots/mime... In any case, all…
I went down a rabbit hole and found most of the missing lists on Common Crawl: https://mirandrom.github.io/bourdain-lists/ Unfortunately, AFAICT, the embedded image data were not included in the Common Crawl scrapes,…
Much appreciated! I'll update my page to link to your much more polished one too :)
I went down the same rabbit hole and did the exact same thing last week in a fit of procrastination. https://news.ycombinator.com/item?id=46185128 Would appreciate a shout-out if you saw it and were inspired, otherwise…
Can't argue with those credentials. Thanks for confirming/clarifying!
I'm not so sure, they say "The crawled content is dominated by HTML pages and contains only a small percentage of other document formats." https://commoncrawl.github.io/cc-crawl-statistics/plots/mime... In any case, all…
I went down a rabbit hole and found most of the missing lists on Common Crawl: https://mirandrom.github.io/bourdain-lists/ Unfortunately, AFAICT, the embedded image data were not included in the Common Crawl scrapes,…