4 ms·
It’s not because you didn’t find use cases for local LLMs that there are none. I use local LLMs on my Mac Mini M4 Pro with 48G to review text messages tone, ac
by LeBit 25d ago
It’s not because you didn’t find use cases for local LLMs that there are none.
I use local LLMs on my Mac Mini M4 Pro with 48G to review text messages tone, act as a text correction tool, act as a code review tool, to do code agent work, generate code snippets, etc
Gemma 4 26B A4B gives me steady 20 tps.