5 ms·
If you gave me an agent that succeeded 50% of tasks I gave it, I could take over the world in a week. Faster if I wasn't so lazy. I think you're overestimating
by boxedemp 5mo ago
If you gave me an agent that succeeded 50% of tasks I gave it, I could take over the world in a week. Faster if I wasn't so lazy.
I think you're overestimating, or oversimplifying. Maybe both.
- raincole 5mo agoNo one is claiming an agent can do 50% of arbitrary tasks. It's just 50% of METR's benchmark set. > I think you're overestimating, or oversimplifying Yeah if you only read comments on HN but not the actual linked article you will get oversimplified conclusion. Like, duh?
- boxedemp 5mo agoSorry for stating something so obvious. I'll comment less from now on.
- TeMPOraL 5mo ago> Yeah if you only read comments on HN but not the actual linked article you will get oversimplified conclusion. Like, duh? Curiously, for most submissions it's the opposite - comments are much more useful and nuanced than the source being discussed.
- jurgenburgen 5mo ago> If you gave me an agent that succeeded 50% of tasks I gave it, I could take over the world in a week. Faster if I wasn't so lazy. Assuming you used o3, that would cost $58800 per week. That’s an expensive bet for only 50% odds in your favor. Of course the agents are only that good on benchmarks, in reality your odds are worse. Maybe roulette instead?