6 ms·
Good reminder that raw tokens/sec numbers can be misleading without latency and context-window considerations.
by hiroakiaizawa 4mo ago
Good reminder that raw tokens/sec numbers can be misleading without latency and context-window considerations.