7 ms·
Would love to see metrics of model performance, comparison with oMLX/OLLAMA/others. Any tooling for local optimization on hardware.
by securecloudgrou 14d ago
Would love to see metrics of model performance, comparison with oMLX/OLLAMA/others. Any tooling for local optimization on hardware.
- securecloudgrou 14d agoTo be more clear, I see you have slotstream doctor --sim-ram N, but extended tooling and optimization for exact local hardware would add value (MTPLX has a nice interface for example).