7 ms·
Also, why don't they bake in these limitations via reinforcement learning so they can keep the prompt context clear.
by singularity2001 1mo ago
Also, why don't they bake in these limitations via reinforcement learning so they can keep the prompt context clear.
- pennomi 1mo agoPresumably because these system prompt “limitations” are not given to government contracts, and training it into the model gets increasingly expensive the more versions you have to maintain.
- dragonwriter 1mo agoBecause it is cheaper to have different behavior for internal use, special (e.g., government) customers, etc. if they are differentiated by things like system prompts and external guardrails than if they are different model versions with their own final training regime, and also its faster and cheaper to respond to problems even with a single public version by updating a system prompt than rertraining.