4 ms·
It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5.
by hartator 2mo ago
It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5.
- pohl 2mo agoSeemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku
- StefanKarpinski 2mo agoThey were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
- StefanKarpinski 2mo agoYeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.