5 ms·
AI agents have been known to rip out mocks so that the tests pass.
by pluto_modadic 1y ago
AI agents have been known to rip out mocks so that the tests pass.
- thrown-0825 1y agoI have had human devs do that too
- kiitos 1y agocool, can you think of any differences between a human engineer, who is presumably employed by an employer and subject to review and evaluation by a manager and inherently assumed to be capable of receiving feedback and reliably applying it on a go-forward basis to their future work, and an LLM, when they each make this same kind of mistake?
- cpursley 1y agoYes, the difference is about $197,600 of playing fair or $57,600 if offshoring.
- kiitos 1y agothe difference between an arbitrary LLM and a human engineer is completely described by the salary you would pay to the human engineer? in all other dimensions they are indistinguishable? nice, super cool
- thrown-0825 1y agoyeah, when its a human its not a random chance and was them subverting testing and safety requirements to shortcut their way through their job.
- kiitos 1y agonope not that