7 ms·
if you have the VRAM, use offical release. quantized model lose focus after long context and can do damages or thinking loop
by ycui7 1mo ago
if you have the VRAM, use offical release. quantized model lose focus after long context and can do damages or thinking loop