6 ms·
There's also ZLUDA, which can run llama.cpp and some other CUDA workloads already without any modification, but it's still maturing.
by jakogut 10mo ago
There's also ZLUDA, which can run llama.cpp and some other CUDA workloads already without any modification, but it's still maturing.