6 ms·Ollama does this, as does llama-server from llama.cppby camdv 5mo agoOllama does this, as does llama-server from llama.cpp