8 ms·
If you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compare
by mhjkl 1mo ago
If you adjust for writing speed, this model is already more efficient than humans. It can run at 233 tps on a 5090 which is roughly 10k words per minute compared to human typing speed of 80 wpm. If you duty cycle it down from 575 watts of 5090 to human speeds it’s about 5 watts.