6 ms·
It’s kinda misleading to omit the generally terrible prompt processing speed on Macs 30 tokens per second looks good until you have to wait minutes for the fir
by zht 10mo ago
It’s kinda misleading to omit the generally terrible prompt processing speed on Macs
30 tokens per second looks good until you have to wait minutes for the first token
- simonw 10mo agoThe tweet I linked to includes that information in the chart.