5 ms·
Wouldn’t it just be easier to crawl the net? Not sure what huggingface has to do with anything here.
by lorreyfum 2mo ago
Wouldn’t it just be easier to crawl the net? Not sure what huggingface has to do with anything here.
- croemer 2mo agoI guess Huggingface datasets are easy to crawl - those datasets are hosted to be crawled. In contrast to the web at large which will be behind Cloudflare etc