6 ms·
I mean it might lead to better performance on the model side. So the tokenizer is better but more expensive.
by jascha_eng 2mo ago
I mean it might lead to better performance on the model side. So the tokenizer is better but more expensive.
6 ms·