5 ms·
Claude tends to disregard "NEVER do X" quite often, but funnily enough, if you tell it "Always ask me to confirm before going X", it never fails to ask you. And
by unchar1 6mo ago
Claude tends to disregard "NEVER do X" quite often, but funnily enough, if you tell it "Always ask me to confirm before going X", it never fails to ask you. And you can deny it every time
- SoftTalker 6mo agoIf it disregards "NEVER do" instructions, why would it honor your denial when it asks?
- jachee 6mo agoBecause it’s just fancy auto-complete.
- Zetaphor 6mo agoThere are plenty of examples in the RL training showing it how and when to prompt the human for help or additional information. This is even a common tool in the "plan" mode of many harnesses. Conversely, it's much harder to represent a lack of doing something
- bw86 6mo agoYou mean like in this example? https://web.archive.org/web/20260313042512/https://gist.github.com/bretonium/291f4388e2de89a43b25c135b44e41f0 https://web.archive.org/web/20260313042512/https://gist.gith... There is never a guarantee with GenAI. If you need to be sure, sandbox it.