6 ms·
Not weird at all, given the variance in Opus' quality over the last few months. wild guess - I wouldn't be surprised if Opus 4.6 was run quantized for a while,
by happycube 3mo ago
Not weird at all, given the variance in Opus' quality over the last few months.
wild guess - I wouldn't be surprised if Opus 4.6 was run quantized for a while, and 4.7/4.8 have QAT for that nerfed size.