5 ms·
It's a mixture of experts model. Only a small part of those parameters are active at any given time. I believe it's 16x110B
by Simon321 2y ago
It's a mixture of experts model. Only a small part of those parameters are active at any given time. I believe it's 16x110B