4 ms·
Running the first question as a test against mradermacher's GGUF of the 20b heretic fails when running llama.cpp as Q4_K_M, but successfully generates the tutor
by romaaeterna 10mo ago
Running the first question as a test against mradermacher's GGUF of the 20b heretic fails when running llama.cpp as Q4_K_M, but successfully generates the tutorial with larger better quality Q8_0