16 ms·
We need benchmarks that can distinguish between continuous learning and long-context extrapolation.
by jballanc 5mo ago
We need benchmarks that can distinguish between continuous learning and long-context extrapolation.
- vrighter 5mo agooh that's easy: continuous learning is not something current architectures can do. So the benchmark for that can be done mentally