4 ms·
Does anyone know whether the 128K is input tokens only? There are a lot of models that have a large context window for input but a small output context. If th
by wkcheng 2y ago
Does anyone know whether the 128K is input tokens only? There are a lot of models that have a large context window for input but a small output context. If this actually has 128k tokens shared between input and output, that would be a game changer.