5 ms·

This is awesome, can't wait for evals against Claude Computer Use!

• amelius 2y ago
  Can we first test this with basic sysadmin work in a simple shell? Can't wait to replace "apt get install" by "gpt get install" and then have it solve all the dependency errors by itself.
  • anonym29 2y ago
    Threat actors can't wait for you to start doing this either.
  • ErikBjare 2y ago
    This had been possible for a year already. My project gptme does it just fine (like many other tools), especially now with Claude 3.5.
    • amelius 2y ago
      I know that it exists. I was just hoping we can make such interactions (practically) bug-free before we move on to the next big thing.
• asdev 2y ago
  how can you write metrics against something that's non deterministic?