6 ms·
What are pp/tg? I get 30t/s on 27B qwen.
by ascii0eks84 23d ago
What are pp/tg? I get 30t/s on 27B qwen.
- throwawayffffas 23d agopp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.
- ascii0eks84 18d agookay, so prefill and decode would be the terms I was already familiar with.