4 ms·
Mistral has solid OCR, STT and TTS models and I would love to support them by switching with all of our business workloads to Mistral... but their LLM models ar
by nik736 11d ago
Mistral has solid OCR, STT and TTS models and I would love to support them by switching with all of our business workloads to Mistral... but their LLM models are sadly not competitive at all. In our business benchmarks their Mistral Medium 3.5 with reasoning is worse than Gemma 4 31B and Glimmer 30B. It's a 128B dense model that's priced accordingly! Mistral Small 4 is way worse than Gemma 4 26B A4B. I applaude the effort that they release those models as open weight but Gemma 4 models are currently way easier to run with more tok/s and less hardware. Their API pricing is just insane for what you get. But I guess enterprise customers don't care about it, this is why they are probably not lowering it.
- BoredomIsFun 11d ago> Mistral Small 4 is way worse than Gemma 4 26B A4B Depends for what purpose? I found large Mistrals are massively better than Gemma 4 at creative writing: have more natural tone, better consistency than 26B as it is MoE.
- nik736 11d agoMistral Small 4 is also a MoE model, with way more params, so I would expect it to perform better. Our benchmark involves around 10% communication and writing in German and English and Gemma 4 26B A4B beats it although creative writing is the only category in our benchmark which might be a bit subjective.