7 ms·
Interesting. Though it seems like they are still incentivized to distill their bigger models downward for more tokens/s.
by aw123 2y ago
Interesting. Though it seems like they are still incentivized to distill their bigger models downward for more tokens/s.