6 ms·
Minstral small 3.2 Q4_K_M and Gemma 3 12b 4 bit are amazing. I run both in LM Studio on a Macbook Pro M3 Pro with 36GB of RAM.
by DrAwdeOccarim 1y ago
Minstral small 3.2 Q4_K_M and Gemma 3 12b 4 bit are amazing. I run both in LM Studio on a Macbook Pro M3 Pro with 36GB of RAM.
- jokoon 1y agocan I call it from the command line?
- DrAwdeOccarim 1y agoYes. LM Studio acts like an OAi endpoint when you turn the server on.