7 ms·
how many tokens/s generation do you get?
by stevenaenns 3mo ago
how many tokens/s generation do you get?
- iagooar 3mo agoBallpark 25-30 tok / sec on the Mac Mini Pro M4 + qwen3.6 35B. The generation itself is good, prefill is known to be slow on any Apple M-chip architecture. It is really decent.