6 ms·It's 5B active params in MoE, not 5B total params (total is 137B).by necubi 4mo agoIt's 5B active params in MoE, not 5B total params (total is 137B).