6 ms·
Yes, I provided detailed numbers here: https://github.com/ggml-org/llama.cpp/discussions/16578 https://github.com/ggml-org/llama.cpp/discussions/16578
by ggerganov 11mo ago
Yes, I provided detailed numbers here: https://github.com/ggml-org/llama.cpp/discussions/16578 https://github.com/ggml-org/llama.cpp/discussions/16578