4 ms·
IMO we might not hit a hard ceiling on capacity, but we will likely hit a wall with data quality
by murzynalbinos 1mo ago
IMO we might not hit a hard ceiling on capacity, but we will likely hit a wall with data quality
- vincenthsin 1mo agoAs human-generated nutritional data runs dry, LLMs will end up eating their own garbage ?
- murzynalbinos 1mo agoYeah, pretty much. Once the good human data runs out and models start training on each other’s output, quality drops fast.
- vincenthsin 1mo agoEven worse, it makes it difficult to distinguish between real and fake data.