https://stability.ai/news/stablelm-zephyr-3b-stability-llm https://stability.ai/news/stablelm-zephyr-3b-stability-llm works absolutely fine on the M2 processor,

https://stability.ai/news/stablelm-zephyr-3b-stability-llm https://stability.ai/news/stablelm-zephyr-3b-stability-llm works absolutely fine on the M2 processor, like 40 tok/s https://x.com/EMostaque/status/1732912442282312099?s=20 https://x.com/EMostaque/status/1732912442282312099?s=20 Stable LM 2 1.6b runs even faster but not as good at RAG, great multilingual though, we are seeing it matching 70b models on other languages (new version soon) https://x.com/EMostaque/status/1763269238347673796?s=20 https://x.com/EMostaque/status/1763269238347673796?s=20 Can fit a lot in a gigabyte file it seems.