5 ms·Large language model data pipelines and Common Crawl (WARC/WAT/WET) formats2 points by perone 3y ago