7 ms·
Either ollama or omlx, both are pretty dang performant. Omlx lets you run Claude code locally though as long as you bootstrap it with the right model
by thomspoon 3mo ago
Either ollama or omlx, both are pretty dang performant. Omlx lets you run Claude code locally though as long as you bootstrap it with the right model
- karussell 3mo agoWhy would you need Omlx? For speed up?
- pornel 3mo agoHas extra KV cache on SSD, and lots more options to tweak. There's experimental TurboQuant and multi token prediction support.
- mike_hearn 3mo agoOmlx is really nice, thanks for the recommendation!