5 ms·
It might have been a typo, as the current llama.cpp / alpaca.cpp included quantizers default to 4 bits.
by DrJosiah 3y ago
It might have been a typo, as the current llama.cpp / alpaca.cpp included quantizers default to 4 bits.
loading thread…
5 ms·