4 ms·

BTW, hi, I'm the one running this challenge -- let me know if you have any questions! So far most of the interest has been from within the existing Opus Magnum

by panic 2y ago

BTW, hi, I'm the one running this challenge -- let me know if you have any questions! So far most of the interest has been from within the existing Opus Magnum community, but maybe some hotshot AI programmer on here can show us all how it's done in October.

YeGoblynQueenne 2y ago
Ah, see, if you wanted to motivate "AI programmers" you'd need a million dollar prize and it would help if you proposed your competition as an AGI challenge. (A veiled reference to ARC-AGI with my usual cynicism). Edit: to make this comment a bit more substantial it looks to me like Opus Magnum is a game where the player must design a custom solver for a puzzle, so it makes sense that there would be "bots" automating the process (where basically writing a bot replaces the game interface with a programming language). The challenge would be in designing a bot that can solve entire classes of Opus Magnum puzzles, maybe even the entire class. In modern AI everything has been done by learning so an "AI programmer" would typically try to machine-learn such a general solver. Unfortunately that is an open problem for modern AI, how to learn general solvers for entire classes of problems. On the other hand, I note that the competition is based on what I understand are procedurally generated puzzles. Now, a program that can generate puzzles should also be able to solve puzzles (in the same way that an automaton that can recognise a string can generate it). Learning to identify a generator from example of its output is an open problem in AI. Learning to identify a solver from examples of its output when run as a generator is, well, even more open. Anyway all this is too much like work for me to be a fun challenge.
pvillano 2y ago
It would be interesting to see the Pareto front for Cost, Cycles and Area for individual puzzles. A badge for Pareto optimality would give everyone a chance of being a winner in some small way.
- OscarCunningham 2y ago
  The experts do in fact track the entire Pareto Frontier in this way: https://biggieblog.com/tracking-the-global-opus-magnum-records/ https://biggieblog.com/tracking-the-global-opus-magnum-recor...

by panic 2y ago

YeGoblynQueenne 2y ago

Ah, see, if you wanted to motivate "AI programmers" you'd need a million dollar prize and it would help if you proposed your competition as an AGI challenge. (A veiled reference to ARC-AGI with my usual cynicism). Edit: to make this comment a bit more substantial it looks to me like Opus Magnum is a game where the player must design a custom solver for a puzzle, so it makes sense that there would be "bots" automating the process (where basically writing a bot replaces the game interface with a programming language). The challenge would be in designing a bot that can solve entire classes of Opus Magnum puzzles, maybe even the entire class. In modern AI everything has been done by learning so an "AI programmer" would typically try to machine-learn such a general solver. Unfortunately that is an open problem for modern AI, how to learn general solvers for entire classes of problems. On the other hand, I note that the competition is based on what I understand are procedurally generated puzzles. Now, a program that can generate puzzles should also be able to solve puzzles (in the same way that an automaton that can recognise a string can generate it). Learning to identify a generator from example of its output is an open problem in AI. Learning to identify a solver from examples of its output when run as a generator is, well, even more open. Anyway all this is too much like work for me to be a fun challenge.

pvillano 2y ago

It would be interesting to see the Pareto front for Cost, Cycles and Area for individual puzzles. A badge for Pareto optimality would give everyone a chance of being a winner in some small way.

OscarCunningham 2y ago
The experts do in fact track the entire Pareto Frontier in this way: https://biggieblog.com/tracking-the-global-opus-magnum-records/ https://biggieblog.com/tracking-the-global-opus-magnum-recor...