7 ms·

I'm not so sure, they say "The crawled content is dominated by HTML pages and contains only a small percentage of other document formats." https://commoncrawl

I'm not so sure, they say "The crawled content is dominated by HTML pages and contains only a small percentage of other document formats." https://commoncrawl.github.io/cc-crawl-statistics/plots/mimetypes https://commoncrawl.github.io/cc-crawl-statistics/plots/mime... In any case, all the images were external cloudfrount URLs that have not been archived anywhere afaict.

ccgreg 9mo ago
Hi. I'm the CTO at Common Crawl. Nice to meet you. There's a small amount of "bycatch", and you already discovered how to see it. Notice that it went down after I was hired.
- mirandrom 9mo ago
  Can't argue with those credentials. Thanks for confirming/clarifying!