6 ms·
Research seems to suggest we need exponential training data volume increases to see meaningful performance gains: https://arxiv.org/abs/2404.04125 https://arxiv
by smartician 2y ago
Research seems to suggest we need exponential training data volume increases to see meaningful performance gains: https://arxiv.org/abs/2404.04125 https://arxiv.org/abs/2404.04125
Personally I think we've already hit a ceiling.
- p1esk 2y agoWe have pretty much infinite training data available on YouTube. We can scale by many orders of magnitude before we run out of data. Why do you think we hit a ceiling?