6 ms·
OpenAI's head of strategic futures publicly stated that you can't explain the quality of the newest Kimi via distillation. Further, you can just read the paper
by calebkaiser 2mo ago
OpenAI's head of strategic futures publicly stated that you can't explain the quality of the newest Kimi via distillation.
Further, you can just read the papers released alongside most open models. Plenty of hugely influential research results published that drive the frontier forward. It's not like these models are just existing architectures downloaded from Huggingface and trained on frontier lab APIs.
- retinaros 2mo agoit cant be explained. but distillation shortcut training time by a lot. you need much more than that to be near SOTA obviously