6 ms·
Llamafile: https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile
by bestcoder69 2y ago
Llamafile: https://github.com/Mozilla-Ocho/llamafile https://github.com/Mozilla-Ocho/llamafile
- lolinder 2y agoLlamafile is great but solves a slightly different problem very well: how do I easily download and run a single model without having any infrastructure in place first? Ollama solves the problem of how I run many models without having to deal with many instances of infrastructure.
- romperstomper 2y agoYou don't need any infrastructure for llamafiles, you just download and run them (everywhere).
- lolinder 2y agoYes, that's what I meant, sorry if it was confusing: The problem that Llamafiles solve is making it easy to set up one model without infrastructure.
- homebrewer 2y agoIt's actually more difficult to use on linux (compared to ollama) because of the weird binfmt contortions you have to go through.
- yjftsjthsd-h 2y agoWhat contortions? None of my machines needed more than `chmod +x` for llamafile to run.