5 ms·
There's some interesting work in NeurIPS this year on fused kernels for MoE too: https://flash-moe.github.io/ https://flash-moe.github.io/
by emaadm 1y ago
There's some interesting work in NeurIPS this year on fused kernels for MoE too: https://flash-moe.github.io/ https://flash-moe.github.io/