ecurtin

5 ms·

1. 1.▲
   by ecurtin 2y ago

   The windows solution is WSL2
2. 2.▲
   by ecurtin 2y ago

   One of the main goals of RamaLama at the start was to be easy to install and run for Silverblue and Kinoite users (and funnily enough that machine had an AMD GPU, so we had almost identical setups). I quickly realized contributing to Ollama
3. 3.▲
   by ecurtin 2y ago

   It's gets out of date with conflicts, etc. Because it's ignored, if this was the upstream project of Ollama, llama.cpp the maintainers would have got this merged months ago.
4. 4.▲
   by ecurtin 2y ago

   This is true.
5. 5.▲
   by ecurtin 2y ago

   @cge you have this right, the main python script has no dependancies, it just uses python3 stdlib stuff. So if you have a python3 executable on your system you are good to go. All the stuff with dependancies runs in a container. On macOS, u
6. 6.▲
   by ecurtin 2y ago

   RamaLama stands on the shoulders of giants by building upon llama.cpp (and other projects like minja, podman, vllm, etc.), we've been contributing back also Sergio Lopez, Michael Engel and I are contributing back to llama.cpp (just thr
7. 7.▲
   by ecurtin 2y ago

   In RamaLama an OCI container-like store is used (at least from the UX perspective it feels like that) for all models in RamaLama, it's protocol agnostic supports oci artefacts, huggingface, ollama, etc.
8. 8.▲
   by ecurtin 2y ago

   I am doing a short talk on this tomorrow at FOSDEM: https://fosdem.org/2025/schedule/event/fosdem-2025-4486-rama...