12 ms·
Since it has low activated parameter count but huge total parameter count it needs more tokens to move the relevant information into the context.
by mordae 6d ago
Since it has low activated parameter count but huge total parameter count it needs more tokens to move the relevant information into the context.
- pampas 6d agoThanks for the help. I ran it on high and it did pretty well and got a lot of one-shots in. The reasoning makes a much bigger difference than some other models.