7 ms·
How is the diversity, duplication?
by jossclimb 1y ago
How is the diversity, duplication?
- tehryanx 1y agobased on the description, I think it's using something similar to GLAN https://arxiv.org/abs/2402.13064 https://arxiv.org/abs/2402.13064
- decodebytes 1y agoVery good, and even better with the new DAG approach - we have been using great-expectations to bench and seeing very good diversity and low amounts of duplication - you check out one of the recent CoT examples here: https://huggingface.co/datasets/lukehinds/deepfabric-devops-reasoning-traces https://huggingface.co/datasets/lukehinds/deepfabric-devops-...
- evgen 1y agoThis dataset disappeared. Did it move or get pulled for some reason? (glanced at it when you noted this and went back today to check it out and found a 404...)