There's actually already a fork that implements the preliminaries: https://github.com/ggml-org/llama.cpp/discussions/21961 https://github.com/ggml-org/llama.cp

There's actually already a fork that implements the preliminaries: https://github.com/ggml-org/llama.cpp/discussions/21961 https://github.com/ggml-org/llama.cpp/discussions/21961