8 ms·
I'm able to use ROCm with MTP just fine (Qwen and Gemma). I use Lemonade and have only the ROCm installed through it (ETA: their llama.cpp version is a fork, n
by data-ottawa 2mo ago
I'm able to use ROCm with MTP just fine (Qwen and Gemma).
I use Lemonade and have only the ROCm installed through it (ETA: their llama.cpp version is a fork, not sure what is different vs the main trunk).