7 ms·
Perhaps something similar to speculative decoding. Speculating Experts Accelerates Inference for Mixture-of-Experts: https://arxiv.org/abs/2603.19289 https://a
by salter2 3mo ago
Perhaps something similar to speculative decoding.
Speculating Experts Accelerates Inference for Mixture-of-Experts: https://arxiv.org/abs/2603.19289 https://arxiv.org/abs/2603.19289