4 ms·
Mind sharing the fix as a patch? I would like to run it this way, too.
by gorgonical 6mo ago
Mind sharing the fix as a patch? I would like to run it this way, too.
- UncleOxidant 6mo agohttps://github.com/philtomson/llama.cpp https://github.com/philtomson/llama.cpp
- gorgonical 5mo agoWorks like a charm for me, just like for you. Getting ~8 tok/s on my middle-of-the-road workstation laptop. Thanks for this!