6 ms·
Regarding the MTP, if you haven't found out why yet, the `--spec-draft-p-min 0.8`. Something to play with and of course it's non-deterministic and depends on bo
by tharkun__ 16d ago
Regarding the MTP, if you haven't found out why yet, the `--spec-draft-p-min 0.8`. Something to play with and of course it's non-deterministic and depends on both the model itself and whatever you're actually throwing at it.
This is what I read before I went to try it: https://github.com/ggml-org/llama.cpp/discussions/25198 https://github.com/ggml-org/llama.cpp/discussions/25198