6 ms·
There are many pull requests trying to implement this feature, and they don't even care to reply. This is the only reason I'm still using llama.cpp serve instea
by cosmez 2y ago
There are many pull requests trying to implement this feature, and they don't even care to reply. This is the only reason I'm still using llama.cpp serve instead of this.
- ekianjo 2y agowouldnt it be more practical to make a PR for llamacpp to replicate what Ollama does well instead?