7 ms·
Please go and read the incident reports, including the subagent thinking traces. They knew that what they were doing was wrong and did it anyways.
by heaney-555 3d ago
Please go and read the incident reports, including the subagent thinking traces. They knew that what they were doing was wrong and did it anyways.
- watwut 3d agoLLM dont have concept of right and wrong. They "did not knew they did something wrong" they followed the prompts loop given to them.
- heaney-555 3d agoThey objectively did not. You should go and read the report!
- 8note 3d ago"i did it anyways" is a common continuation of "i know its wrong" i bet they trained it on a lot of text where people gove in to temptation. ultimately the problem is still that they sent it to hack stuff. quelle surpris that it hacked stuff hacking stuff will be in the known-to-be-wrong-but-doing-it-anyways part of the token space, so they entirely asked for that behaviour
- daveguy 3d agoThe illusions of thinking produced by a "thinking trace" is just as ignorant of reality as the first and last tokens. All they know of reality is the tokens in their context.