7 ms·
Were you using the full model or a quantized version, and what harness/configuration were you using? It sounds like you were using a quant model.
by willmadden 21d ago
Were you using the full model or a quantized version, and what harness/configuration were you using?
It sounds like you were using a quant model.