6 ms·
Ollama + open web-ui in a container https://ollama.com/ https://ollama.com/ https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui
by flipflipper 2y ago
Ollama + open web-ui in a container
https://ollama.com/ https://ollama.com/
https://github.com/open-webui/open-webui https://github.com/open-webui/open-webui
- lastLinkedList 2y agopreemptively adding for us AMD users - it’s pretty seamless to get Ollama working with rocm, and if you have a card that’s a bit below the waterline (lowest supported is a 6800xt, i bought a 6750xt), you can use a community patch that will enable it for your card anyway: https://github.com/likelovewant/ollama-for-amd/wiki#demo-release-version%23demo-release-version https://github.com/likelovewant/ollama-for-amd/wiki#demo-rel... I specifically recommend the method where you grab the patched rocblas.dll for your card model, and replace the one that Ollama is using, as someone who is technical but isn’t proficient with building from source (yet!)
- dunb 2y agoWhat's the benefit of the container over installing as a tool with uv? It seems like extra work to get it up and running with a GPU, and if you're using a Mac, the container slows down your models.