6 ms·
It'll be really interesting when they run RL training on the harness self-improvement loop. I've tried using LLMs for harness engineering, but it often creates
by supermdguy 1mo ago
It'll be really interesting when they run RL training on the harness self-improvement loop. I've tried using LLMs for harness engineering, but it often creates too much bloat that weighs things down in the end. Guessing it's just not something the models are tuned to do by default.
Curious if anyone's tried using RL for harness engineering? I think we're still pretty far away from the optimal harness, especially when it comes to long-context memory management.
- fizx 1mo agoWhat policy would you use?
- astrobiased 1mo agoNot RL. SFT.
- supermdguy 1mo agoInteresting, what did you use for the data? And do you have a write-up anywhere?
- astrobiased 1mo agoYes, used bert model with decent results.