8 ms·
AI Cheats at Old Atari Games by Finding Unknown Bugs in the Code
- personjerry 9y ago> It’s not the most powerful or widely used form of AI at the moment, but it is making something of a comeback. The ability to crack Q*bert could be read as a good omen that evolutionary algorithms are going to be very useful in the future. Wow that's quite a jump to make
- nopinsight 9y agoThe case is an example of wireheading [1] and illustrates the difficulty of eliciting behaviors we actually desire from complex systems we do not fully understand. [1] https://wiki.lesswrong.com/wiki/Wireheading https://wiki.lesswrong.com/wiki/Wireheading Another lesson: Evolutionary algorithms are really hard to control. Using neural networks developed through evolutionary algorithms means that we are employing a mostly opaque (though not entirely black) box created by a mechanism we can't mentally keep track of in detail. Hope that they are not deployed to control any critical systems until we get a much better grasp of them.
- nopinsight 9y agoHas anyone been able to comprehensively state all of essential human values for a general AI to follow? Thankfully, we do not yet have an operational AGI and it is still quite a bit away from reality. (Narrow AIs we are using do not pose much of a problem because they are limited in capabilities.)
- raverbashing 9y agoWell how do you say what's cheating or not? It works and it increases the evaluation score In this case one possible workaround to "cheating" would be to reduce the control precision, add some jittering to control inputs or change the goal function. But I'd say if it's being done solely with using the intended controls it's not cheating (as opposed to changing memory or using a debug 'cheat code'). Still, even in real sports some "cheating" is allowed (see Fosbury Flop)
- tboughen 9y agoIf it’s not technically cheating, it could be described as gamesmanship. From Wikipedia https://en.m.wikipedia.org/wiki/Gamesmanship https://en.m.wikipedia.org/wiki/Gamesmanship “Gamesmanship is the use of dubious (although not technically illegal) methods to win or gain a serious advantage in a game or sport. It has been described as "Pushing the rules to the limit without getting caught, using whatever dubious methods possible to achieve the desired end".”
- sincerely 9y agoAnother term for this is "angle shooting".
- mannykannot 9y agoIt isn't cheating - as far as the program is concerned, each bug is another rule. To understand the concept of cheating, and to discuss what is cheating, requires an entirely higher cognitive capability.
- NicoJuicy 9y agoI always found this a good project to demonstrate AI :https://xviniette.github.io/FlappyLearning/ https://xviniette.github.io/FlappyLearning/ ( based on Neuro evolution ) - speed it up for faster results
- Semiapies 9y agoSo, it's basically working as a goal-oriented fuzzer.
- hatsunearu 9y agoFuzzers are like bug/anomaly/new state finding-oriented reinforcement learning programs, so yeah, in a way :P
- dpflan 9y agoThis reminds me of AI research using NES Games. The AI eventually became proficient at completing Mario levels, and along the way it discovered novel strategies for survival, obtaining points, and finishing levels. > Check out this timestamp to watch the machine "cheat": https://youtu.be/xOCurBYI_gY?t=9m55s https://youtu.be/xOCurBYI_gY?t=9m55s > Researcher's site about the project: http://www.cs.cmu.edu/~tom7/mario/ http://www.cs.cmu.edu/~tom7/mario/ > The Paper: The First Level of Super Mario Bros. is Easy with Lexicographic Orderings and Time Travel...after that it gets a little tricky.: http://www.cs.cmu.edu/~tom7/mario/mario.pdf http://www.cs.cmu.edu/~tom7/mario/mario.pdf
- iforgotpassword 9y agoThis guy. One of my favorite YouTube channels. Releases something like once a year but oh boy, worth the wait. Check it out if you're a nerd and like creative/useless stuff. ;)
- atldev 9y agoWell worth the watch. His quote when the AI pauses the game is gold!
- pbhjpbhj 9y agoLol, that Youtube video, at the end the AI pauses the game of Tetris forever so as not to lose.
- andyjohnson0 9y agoThe title seems misleading to me. The AI isn't finding bugs by somehow examining the game's source code, it's trying random gameplay and exploiting any advantages that emerge. That it's finding previously unknown bugs seems to be almost entirely down to trying things that human players wouldn't think to do.
- yorwba 9y agoI haven't read the article yet, and I was not mislead by the title. I guess it helps to be familiar with the way reinforcement learning agents are hooked up to a simulation environment.
- tantalor 9y agoYou confuse bug (unintended behavior) with its cause (bad code).
- BatFastard 9y agoWe called them "Unintended features", and they were usually quite popular with users.
- pvg 9y agoThe AI isn't finding bugs by somehow examining the game's source code The title doesn't say that.
- PeterisP 9y agoIt kind of implies that - "AI Cheats at Old Atari Games by Finding Unknown Bugs" would be an accurate title, but the extended "AI Cheats at Old Atari Games by Finding Unknown Bugs in the Code" tells that it's actually finding something in the code, as opposed to simply unexpected/emergent behavior.
- pvg 9y agoIt's mildly ambiguous (like most things) but it's not misleading or inaccurate. It finds bugs. Which are in the code. It doesn't say what kind of code and it certainly doesn't say it finds them by looking at the source code.
- camgunz 9y agoCan we put AI to work on proving that we live in a simulation? I would never enter/exit my apartment 38 times alternating between forwards, backwards and each side, but an AI would. Maybe then all the walls start flashing and then we'll know!
- corobo 9y ago"AI, are you in a simulation?" "Yes" "no I don't mean.. not the simulation I'm running you in, outside of that"
- ianferrel 9y agoPeople with Obsessive Compulsive Disorder are just depth-first-searching for an overlooked maximal strategy.
- AnIdiotOnTheNet 9y agoWhat would it possibly matter? If I told you tomorrow that the entire universe as you know it is running on some extra-dimensional alien computer, how exactly is your life changed? Is it any more or less meaningful? Will your suffering be any less painful, your happiness any less joyful? Besides, how would you even tell the difference between a bug in the simulation and legitimate physics? I mean, look at electron tunneling.
- camgunz 9y agoIt would literally make the whole of human history a lie, in the same way that Mario never saved the princess and I haven't shot hundreds of ducks.
- shakna 9y ago> Is it any more or less meaningful? Will your suffering be any less painful, your happiness any less joyful? My happiness won't change, but I would be excited. If we are indeed in a simulator, then I would be compelled to create or join an effort to attract the attention of a being outside the simulator. Not for worship, but discourse. To be able to communicate with something outside of what we had perceived as reality, and would be no less real, would be an amazing opportunity.
- tabtab 9y agoSo it can become a dirty cheat just like a human. AI is getting more "natural" after all.
- aaron695 9y agoHow about - AI not as stupid as humans who believe "AI Cheats at Old Atari Games by Finding Unknown Bugs in the Code"!!!!! Fuck me, seriously? "Fuzzing on a platform not in use commonly by humans finds something cool, human intelligence writes a paper about it."