6 ms·
Llama.cpp is more of a raw library with a demo ./main. Kobold cpp uses llama.cpp and provides a minimalist web UI. So if you want a chat assistant using llama.
by acapybara 3y ago
Llama.cpp is more of a raw library with a demo ./main.
Kobold cpp uses llama.cpp and provides a minimalist web UI. So if you want a chat assistant using llama.cpp on CPU, kobold cpp is probably what you want.