5 ms·
Not really. There's no fundamental difference between input and output tokens technically. The internal model space is exactly the same after evaluating some
by trissi1996 2y ago
Not really.
There's no fundamental difference between input and output tokens technically.
The internal model space is exactly the same after evaluating some given set of token, no matter which of them were produced by the prompter or the model.
The 16k output token limit is just an arbitrary limit in the chatgpt interface.
- OutOfHere 2y ago> The 16k output token limit is just an arbitrary limit in the chatgpt interface. It is a hard limit in the API too, although frankly I have never seen an API output go over 700 tokens.