23 ms·

Setting up OpenCode with Ollama and sbx on Mac

31 points by etoxin 6d ago

slimelephant 6d ago
[flagged]
cube00 6d ago
>Why I use Ollama. To be frank it's just easy. More ethical alternatives have caught up including llama.cpp https://sleepingrobots.com/dreams/stop-using-ollama/#what-to-use-instead https://sleepingrobots.com/dreams/stop-using-ollama/#what-to...
- LoganDark 6d ago
  Very ironic how that article looks like it was LLM generated.
  - reaperducer 6d ago
    Dogfooding it!
    - LoganDark 6d ago
      At least it looks like the quality control wasn't too bad!
hkchad 6d ago
Friends don't let friends use Ollama
- yonatan8070 6d ago
  Can you elaborate for your unaware Ollama-using friends?
  - matusnovak 6d ago
    What the parent comment is referencing: https://sleepingrobots.com/dreams/stop-using-ollama/ https://sleepingrobots.com/dreams/stop-using-ollama/
villgax 6d ago
Lol why bother with bloat ollama
manapause 6d ago
If you have both ollama and llama.cpp installed on your MBP, and are interested in utilizing your local model as a cost-saving preprocessor for your frontier models, consider using https://github.com/Standard-Pentest/kultivait https://github.com/Standard-Pentest/kultivait! "kultivait init --setup" to evaluate your machine's hardware, access to frontier cli-tools, download models, and create a proxy for ollama to get started. works great with opencode!
- manapause 6d ago
  Note: I am replying to my own post to say that Kultivait llama.cpp functionality is currently broken but under active development. Ollama proxy and model selection does work. If you run into issues or have any questions please feel free to reach out.
darthcircuit 6d ago
I’ve been using OMLX on 48gb Mac. It’s a lot smoother setup than Ollama and has a built in model sizer and all that in a nice ui. Also will pre configure and launch opencode, pi, Hermes, codex and Claude out of the box with no fuss. I’ve been really happy with it.
- etoxin 6d ago
  I did try oMLX, mlx and LM studio (Now Bionic). I returned back to Ollama because of stability issues.
  - slimelephantjbx 6d ago
    Ollama is the best for backends, I prefer using LM mini as a UI though, cause it lets me sync chats between my phone and mac.
hefu_hk 6d ago
[flagged]
vivzkestrel 6d ago
- Stop using OLLAMA - https://sleepingrobots.com/dreams/stop-using-ollama/ https://sleepingrobots.com/dreams/stop-using-ollama/ - also can we get a post on how to do this with llama.cpp

31 points by etoxin 6d ago

[flagged]

>Why I use Ollama. To be frank it's just easy. More ethical alternatives have caught up including llama.cpp https://sleepingrobots.com/dreams/stop-using-ollama/#what-to-use-instead https://sleepingrobots.com/dreams/stop-using-ollama/#what-to...

LoganDark 6d ago
Very ironic how that article looks like it was LLM generated.
- reaperducer 6d ago
  Dogfooding it!
  - LoganDark 6d ago
    At least it looks like the quality control wasn't too bad!

hkchad 6d ago

Friends don't let friends use Ollama

yonatan8070 6d ago
Can you elaborate for your unaware Ollama-using friends?
- matusnovak 6d ago
  What the parent comment is referencing: https://sleepingrobots.com/dreams/stop-using-ollama/ https://sleepingrobots.com/dreams/stop-using-ollama/

villgax 6d ago

Lol why bother with bloat ollama

manapause 6d ago

If you have both ollama and llama.cpp installed on your MBP, and are interested in utilizing your local model as a cost-saving preprocessor for your frontier models, consider using https://github.com/Standard-Pentest/kultivait https://github.com/Standard-Pentest/kultivait! "kultivait init --setup" to evaluate your machine's hardware, access to frontier cli-tools, download models, and create a proxy for ollama to get started. works great with opencode!

manapause 6d ago
Note: I am replying to my own post to say that Kultivait llama.cpp functionality is currently broken but under active development. Ollama proxy and model selection does work. If you run into issues or have any questions please feel free to reach out.

darthcircuit 6d ago

I’ve been using OMLX on 48gb Mac. It’s a lot smoother setup than Ollama and has a built in model sizer and all that in a nice ui. Also will pre configure and launch opencode, pi, Hermes, codex and Claude out of the box with no fuss. I’ve been really happy with it.

etoxin 6d ago
I did try oMLX, mlx and LM studio (Now Bionic). I returned back to Ollama because of stability issues.
- slimelephantjbx 6d ago
  Ollama is the best for backends, I prefer using LM mini as a UI though, cause it lets me sync chats between my phone and mac.

hefu_hk 6d ago

[flagged]

vivzkestrel 6d ago

- Stop using OLLAMA - https://sleepingrobots.com/dreams/stop-using-ollama/ https://sleepingrobots.com/dreams/stop-using-ollama/ - also can we get a post on how to do this with llama.cpp