7 ms·
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.
by fy20 13d ago
It's the opposite kind of bundling as MoE, which effectively trades memory/storage to save on compute at inference time.