7 ms·

So when the context window rolls over, this system prompt is reinserted?

• immibis 3y ago
  It's more likely that it truncates the user prompt.
• wongarsu 3y ago
  I'd think of it more as keeping state in a separate object, and reassembling the prompt each time as system prompt + the most recent user/assistent conversation pairs + current user prompt. Then you can just shorten the conversation history in the middle to fit your context window. If you are fancy you add a summary of everything you have cut, but I'm not sure if ChatGPT does that.
• ShamelessC 3y ago
  Yes. It's present in every request made.