5 ms·
Hmm.. pacman -Ss ollama | wc -l 16 pacman -
by denismi 5mo ago
Hmm..
pacman -Ss ollama | wc -l
16
pacman -Ss llama.cpp | wc -l
0
pacman -Ss lmstudio | wc -l
0
Maybe some day.
- mongrelion 5mo agollama.cpp moves too quickly to be added as a stable package. Instead, you can get it directly from AUR: https://aur.archlinux.org/packages?O=0&K=llama.cpp https://aur.archlinux.org/packages?O=0&K=llama.cpp There are packages for Vulkan, ROCm and CUDA. They all work.
- yjftsjthsd-h 5mo agoThat doesn't make sense. Why would llama.cpp need to move any faster than ollama? For that matter, why not have a llama.cpp package and llama.cpp-git in the AUR?
- rf15 5mo agowhat are you talking about? llama.cpp doesn't need to respect ollamas speed at all. It does not depend on it, it's the opposite of that.
- yjftsjthsd-h 5mo agoThe claim was that llama.cpp moves too fast to be in Arch's normal repos. But Arch does package ollama. Therefore, either 1. ollama somehow avoids the need to move fast, or 2. it moves at an acceptable pace when packaged. Edit: Or perhaps put differently: If ollama includes a copy of llama.cpp and has a non-AUR package, why can't there be a non-AUR package that's just llama.cpp without ollama?
- FlyingSnake 5mo agoyay -S llama.cpp I just installed llama.cpp on CachyOS after reading this article. It’s much faster and better than Ollama.
- tmtvl 5mo agoThen again... zypper --no-refresh search llamacpp | tail -n5 | wc -l 5 Sometimes Arch has the software you want at the version you want, other times it doesn't but other distros do. That's why there's half a billion distros instead of just one.