Right, DVC caches data for consistency and reproducibility. If caching is not needed and streaming required, we've created a sister tool DataChain. It's even s

Right, DVC caches data for consistency and reproducibility. If caching is not needed and streaming required, we've created a sister tool DataChain. It's even supports WebDataset and can stream from tar archives and filter images by metadata. WebDataset example: https://github.com/iterative/datachain/blob/main/examples/multimodal/wds_filtered.py https://github.com/iterative/datachain/blob/main/examples/mu...