6 ms·
What do you use instead of llama.cpp? With vllm for example most models don't seem to be supported out of the box.
by mhitza 1mo ago
What do you use instead of llama.cpp? With vllm for example most models don't seem to be supported out of the box.