4 ms·
I wrote a similar post some time ago just used ollama and opencode https://blog.kulman.sk/running-local-llm-coding-server/ https://blog.kulman.sk/running-local-
by ig0r0 3mo ago
I wrote a similar post some time ago just used ollama and opencode https://blog.kulman.sk/running-local-llm-coding-server/ https://blog.kulman.sk/running-local-llm-coding-server/
- sleepybrett 3mo agoactually useful and the ollama gui could probably even simplify this more.
- takethebus 3mo agothis is the way, given anyone could swap for oh my pi / pi / etc
- mark_l_watson 3mo agoyes, whether for home experiments or at work, it is good practice (good hygiene) to be able to swap out both agentic harnesses and models. It is important to have a good strategy for exporting skills, etc.
- ig0r0 3mo agoyeah, I am using Pi right now, I switched from OpenCode
- carter2099 3mo agoI'm considering this right now. Is it very difficult to adapt to the new philosophy? Are you running mostly interactive or programmatic?
- ig0r0 3mo agoWhat do you mean by new philosophy? I use Pi the same way I used gpt or sonnet, just for simpler tasks.
- carter2099 3mo agoPi is an agent, gpt and sonnet are LLMs. Opencode is an agent, and has a drastically different philosophy than Pi. FWIW, I took the dive on Pi today and I’m really happy with my decision so far
- ig0r0 3mo agoYeah, I meant using Pi with the local qwen model vs when I was using claude with sonnet or codex with gpt
- krzyk 3mo agoOllama is not a good choice - https://sleepingrobots.com/dreams/stop-using-ollama/ https://sleepingrobots.com/dreams/stop-using-ollama/ As for oprncode, doesn't the system prompt eat too much of the context? Local models are really constraint in regards contex, and opencode AFAIR uses a 10k of it or some thing close.
- naikrovek 3mo agoOllama seems fine to me, technically. it works. why wouldn't someone use it? Because someone else doesn't like it? if it cost money, I'd pay more attention to the people behind it, but I don't, so I don't. I wish people would stop wasting their outrage budget on things like this and pay more attention to politics.
- krzyk 3mo agoFocusing outrage on politics is pointless. Technical people are rather good at learning new things, and ollama situation is a good learning experience. llama.cpp gets you more tokens/s even if you ignore ollama team bad behavior.
- naikrovek 3mo agoPolitical outrage is only pointless (in the cases when it is actually pointless), because not enough people get outraged. Politicians count on your apathy so they can get away with their horseshit. You paying attention is kryptonite to crooked politicians.
- ingvay7 3mo ago[dead]
- amrtn 3mo agoDid you have any issue with tool calling inside opencode? I tried the same approach, but my models don't see any tool.
- ig0r0 3mo agoNo issues with OpenCode and the Qwen models. Some issues with Pi because it uses different tool calling format, but I solved that with an extension.