7 ms·
1. The benchmark is run with a python script - https://github.com/sunblaze-ucb/exploitgym https://github.com/sunblaze-ucb/exploitgym using an agent harness. I s
by meander_water 2mo ago
1. The benchmark is run with a python script - https://github.com/sunblaze-ucb/exploitgym https://github.com/sunblaze-ucb/exploitgym using an agent harness. I suspect they used codex. So the model has access to the environment and could trivially inspect its own source code, which has lots of references to exploit gym and docs relating to it.
2. Hanlons Razor