6 ms·
Has anyone had success using 2 agents, with one as the creator and one as an adversarial "reviewer"? Is the output usually better or worse?
by RS-232 6mo ago
Has anyone had success using 2 agents, with one as the creator and one as an adversarial "reviewer"? Is the output usually better or worse?
- esafak 6mo agoThis is routine. We have Gemini (which is not our coding model) review our PRs and it genuinely catches mistakes. Even using the same model as the creator, without its context to bias it, would probably catch many mistakes.
- sanxiyn 6mo agoThat works well. Anthropic wrote a writeup on it. https://www.anthropic.com/engineering/harness-design-long-running-apps https://www.anthropic.com/engineering/harness-design-long-ru...
- mapontosevenths 6mo agoThis is how its meant to be done. Usually with the reviewer being the stronger model. That said, with both the test driven development this post describes and the reviewer model (its best to do both) you have to provide an escape hatch or out for the model. If you let the model get inescapably stuck with an impossible test or constraints it will just start deleting tests or rewriting the entire codebase in rust or something. My escape hatch is "expert advice". I let the weak LLM phone a friend when its stuck and ask a smarter LLM for assistance. Its since stopped going crazy and replacing all my tests with gibberish... mostly.
- peytongreen_dev 6mo ago[dead]