5 ms·
Relevant PR: https://github.com/ggml-org/llama.cpp/pull/27742 https://github.com/ggml-org/llama.cpp/pull/27742 This branch works now: https://github.com/unslot
by flounder3 22d ago
Relevant PR: https://github.com/ggml-org/llama.cpp/pull/27742 https://github.com/ggml-org/llama.cpp/pull/27742
This branch works now:
https://github.com/unslothai/llama.cpp/tree/qwen4exp/qwen3.8-flash-next https://github.com/unslothai/llama.cpp/tree/qwen4exp/qwen3.8...
cmake -B build -DGGML_CUDA=ON
or
cmake -B build -DGGML_METAL=ON
then
cmake --build build --config Release -j --target llama-server llama-cli