5 ms·
Different bubble than the one I was hoping for. This appears to be different than the recent "Speculative Pipeline Decoding" paper: https://arxiv.org/abs/2605.
by gardnr 3mo ago
Different bubble than the one I was hoping for.
This appears to be different than the recent "Speculative Pipeline Decoding" paper: https://arxiv.org/abs/2605.30852 https://arxiv.org/abs/2605.30852