6 ms·Jeez, I thought I could get away with q8_0 KV cache. Guess not.by arcanemachiner 25d agoJeez, I thought I could get away with q8_0 KV cache. Guess not.