8 ms·
Anyone know if a MoE model that can run on a gpu with 16GB VRAM (like 3.6-35B-A3B) is in the pipeline as well, or only the dense 27B one?
by 13hours 1mo ago
Anyone know if a MoE model that can run on a gpu with 16GB VRAM (like 3.6-35B-A3B) is in the pipeline as well, or only the dense 27B one?
- petu 1mo agoWhoever runs their Twitter wouldn't confirm / promise anything beyond 27B, but didn't say no either. So maybe in a month, maybe not.