4 ms·
It's not cheaper than Deepseek V3.1, though, and Deepseek outperforms on nearly everything. And only between 1- 3x the throughput based on the openrouter metric
by sauwan 1y ago
It's not cheaper than Deepseek V3.1, though, and Deepseek outperforms on nearly everything. And only between 1- 3x the throughput based on the openrouter metrics (near equivalent throughput if you use an FP8 quant). Wish I could be a little more excited about this one.
- amai 1y agoMistral seems to be the only company that doesn‘t fake benchmarks. That makes it of course not exciting. But it doesn‘t have to be to be useful.
- YetAnotherNick 1y agoWhat are you basing this on?