6 ms·

That's a great story! It definitely speaks to human beings' knack for finding edge cases. Do you know what year that was? I'm wondering if AI has advanced and

That's a great story! It definitely speaks to human beings' knack for finding edge cases. Do you know what year that was? I'm wondering if AI has advanced and patched those weaknesses.

sillysaurusx 5y ago
I am of the surprisingly-controversial opinion that ML’s future is going to be as a human empowerment tool — a bicycle for the mind, yet so much more. Listen to how cool my gamedev music sounds: https://soundcloud.com/theshawwn/sets/ai-generated-videogame-music https://soundcloud.com/theshawwn/sets/ai-generated-videogame... I feel comfortable saying that it’s awesome and being immodest, because I didn’t write it! None of those notes are mine. “Crossing the Channel” has one of the strangest tempos I’ve heard, yet it sounds so cool because I think the model made a mistake early on, and decided it wasn’t a mistake — instead, it came up with the most likely not-mistake it could think of, and it happened to sound great. But I “wrote” all ~20 songs on that list in one night. Took about six hours, aka a standard workday. I don’t think it’s production-grade music - far from it - but it also wasn’t a production grade model. (On the other hand, it was trained by gwern, so I’m skeptical the production models of the future will capture all the little magic that he seems to imbue into his.) I chose the instruments, I decided what sounded good, but I didn’t write a single note. It felt a lot like listening to someone jam out, and asking them to play different things. I was just the fella who was there to listen. That’s where ML is going to shine. The future is going to be so exciting with the things you’ll be able to do. But not in the current direction, I think. Currently, the goal is to factor the human out of the equation entirely. So the answer to your question is: even if the AI has “advanced”, its only because they added this case to the training set. If a human was at the helm, they would have annihilated you, because they’d see what you were doing and pilot the AI over to you. I am skeptical this case is solvable, in a fully automatic way. IMO human empowerment will happen by arming actual humans with these models. (Depressingly, “arming” might have a few meanings depending on how AI war turns out, but that’s a different conversation.)
- Rodeoclash 5y ago
  Interesting songs. "Crossing the Channel" doesn't seem to have a strange tempo so much as the piano chord on the offbeat (and perhaps some swing on it as well, I can't quite tell). The problem I think AI generate music has to overcome is that it kind of meanders around without coming to any "conclusions". That said, perhaps this is the perfect music for wandering around a town in an RPG!
  - XorNot 5y ago
    This is where the human element comes in though I would think: a guiding hand to say "start ramping up to more of that, okay now you want a lull here..."
  - FractalHQ 5y ago
    The best music I’ve heard from AI by far is AIVA[0], the “AI Composer” with a YouTube channel uploading a couple new songs every week. I’d argue its the only generated music I’ve heard that could pass as “good”. I don’t think it will be long before AI composers are better than all but the most talented humans. [0] https://youtube.com/channel/UCykVChITx5kqBoGkzfz8iZg https://youtube.com/channel/UCykVChITx5kqBoGkzfz8iZg
- Balgair 5y ago
  > I am of the surprisingly-controversial opinion that ML’s future is going to be as a human empowerment tool — a bicycle for the mind, yet so much more. In chess, these players are called centaurs. Per my limited knowledge of the current chess meta, they are considered to be much better than either people or AI in isolation. https://en.wikipedia.org/wiki/Advanced_chess https://en.wikipedia.org/wiki/Advanced_chess
  - deleted 5y ago
    [deleted]
  - sillysaurusx 5y ago
    Heck yeah, thank you! It's delightful that there's a name for it, because it seems like the first people to become centaurs in their day to day lives will have a massive advantage over those that want the purity of unguided AI. I was eagerly hoping for a video of a centaur vs centaur tournament, but there seem to be none. https://www.youtube.com/results?search_query=centaur+chess https://www.youtube.com/results?search_query=centaur+chess At least, not yet. Maybe someone could do a tournament with https://www.twitch.tv/gmnaroditsky https://www.twitch.tv/gmnaroditsky or https://www.twitch.tv/gmhikaru https://www.twitch.tv/gmhikaru? Actually, the Gotham Chess guy might: https://www.youtube.com/watch?v=O1b-cuPDBZo&list=PLBRObSmbZluRH5GNp2gBxuxxItplWml17&index=2&ab_channel=GothamChess https://www.youtube.com/watch?v=O1b-cuPDBZo&list=PLBRObSmbZl... He's always looking for new angles for his Youtube channel. Centaurism isn't applicable to every situation -- Starcraft's AI kicks the butts of every pro player, because you can scale up and overwhelm your opponent. But there are often already humans in the mix, in these models. The humans are just designing the loss functions or deciding what to model, rather than using the results. So it's a "delayed" mechanical turk in that sense. When done right, it's so effective that it feels like cheating^Wthe future: https://twitter.com/theshawwn/status/1182208124117307392 https://twitter.com/theshawwn/status/1182208124117307392 Those are some of the nicest Stylegan outputs I've ever made. (Uh, do me a favor and ignore the Zeus one...) Each of them were crafted. The process was to start with something, and that "something" often didn't need to be anything close. For example, if the photo is an old man, but stylegan's showing a kid, you turn up the "age" slider. Do that for every feature; it felt like the character creation screen in fallout. Amazed it isn't an app yet. Artbreeder is nice, but it's not the same -- the key component was to have Peter Baylies' (follow him! https://twitter.com/pbaylies https://twitter.com/pbaylies) reverse encoder as a button you can press. Whenever the model gets too far from what you're thinking, you press it, and it morphs the face back closer to the target photo. In the process, it might distort the age slightly, or make the chin a little bigger, but it's an anchor at sea; it's why you can nail your final result, every time. I predict Centaurism might be popularized by gamedev. It's going to be pretty neat when some studio trains an RL algorithm vs someone's heart rate. Higher heart rate = more enjoyment, lots of the time, so you'd end up with either the funnest game or the scariest game you've ever seen. Probably a decade away from that though.
Iv 5y ago
The whole point of running such a stand is to get high quality data from players and make the AI learn from them. You don't 'patch' a reinforcement learning model, you just give it data to train on.
deleted 5y ago
[deleted]
tester34 5y ago
""AI"" will probably never be good in games like Dota2, League of Legends they're way too complex, even in above mentioned example it was 1vs1, meanwhile in general those games are 5vs5 (lol at least)
- drdeca 5y ago
  Never is a long time (...hopefully) Not too long ago, I think some people would have said the same about go.
  - tester34 5y ago
    the difference is that e.g lol constantly changes and you'd have to relearn significant part of game every iirc 2 weeks also those games are waaaaaaaaay more complex than e.g chess I guess we'd need giant advance in computational power in order to analyze hundreds of thousands of matches
- jjcm 5y ago
  I'm sorry but this is just incorrect - OpenAI beat the previous year's champions in a 5v5 match the year after the 1v1 debut: https://www.youtube.com/watch?v=pkGa8ICQJS8 https://www.youtube.com/watch?v=pkGa8ICQJS8 There were restrictions / rules on the game (only a pool of 18 heroes were allowed), but they they won both games in a best of 3. You can see the progression / evolution of the training of the AI here: https://openai.com/projects/five/ https://openai.com/projects/five/ It's definitely doable to train them to be good at extremely complex games like Dota / League, it's just that the resource requirements to train the engine are significant. After the bots were opened to the public, they had a 99.4% win rate against pubs, even accounting for cheese strats.
  - dpatterbee 5y ago
    It's worth mentioning that the restrictions they placed on the game were enormous, to the point that the human players were almost playing a different game. It certainly beat OG in many aspects, but the beauty of dota is the ability to adapt in the game with different strategies, strategies which weren't possible with the restrictions.

That's a great story! It definitely speaks to human beings' knack for finding edge cases. Do you know what year that was? I'm wondering if AI has advanced and patched those weaknesses.

sillysaurusx 5y ago

I am of the surprisingly-controversial opinion that ML’s future is going to be as a human empowerment tool — a bicycle for the mind, yet so much more. Listen to how cool my gamedev music sounds: https://soundcloud.com/theshawwn/sets/ai-generated-videogame-music https://soundcloud.com/theshawwn/sets/ai-generated-videogame... I feel comfortable saying that it’s awesome and being immodest, because I didn’t write it! None of those notes are mine. “Crossing the Channel” has one of the strangest tempos I’ve heard, yet it sounds so cool because I think the model made a mistake early on, and decided it wasn’t a mistake — instead, it came up with the most likely not-mistake it could think of, and it happened to sound great. But I “wrote” all ~20 songs on that list in one night. Took about six hours, aka a standard workday. I don’t think it’s production-grade music - far from it - but it also wasn’t a production grade model. (On the other hand, it was trained by gwern, so I’m skeptical the production models of the future will capture all the little magic that he seems to imbue into his.) I chose the instruments, I decided what sounded good, but I didn’t write a single note. It felt a lot like listening to someone jam out, and asking them to play different things. I was just the fella who was there to listen. That’s where ML is going to shine. The future is going to be so exciting with the things you’ll be able to do. But not in the current direction, I think. Currently, the goal is to factor the human out of the equation entirely. So the answer to your question is: even if the AI has “advanced”, its only because they added this case to the training set. If a human was at the helm, they would have annihilated you, because they’d see what you were doing and pilot the AI over to you. I am skeptical this case is solvable, in a fully automatic way. IMO human empowerment will happen by arming actual humans with these models. (Depressingly, “arming” might have a few meanings depending on how AI war turns out, but that’s a different conversation.)

Rodeoclash 5y ago
Interesting songs. "Crossing the Channel" doesn't seem to have a strange tempo so much as the piano chord on the offbeat (and perhaps some swing on it as well, I can't quite tell). The problem I think AI generate music has to overcome is that it kind of meanders around without coming to any "conclusions". That said, perhaps this is the perfect music for wandering around a town in an RPG!
- XorNot 5y ago
  This is where the human element comes in though I would think: a guiding hand to say "start ramping up to more of that, okay now you want a lull here..."
- FractalHQ 5y ago
  The best music I’ve heard from AI by far is AIVA[0], the “AI Composer” with a YouTube channel uploading a couple new songs every week. I’d argue its the only generated music I’ve heard that could pass as “good”. I don’t think it will be long before AI composers are better than all but the most talented humans. [0] https://youtube.com/channel/UCykVChITx5kqBoGkzfz8iZg https://youtube.com/channel/UCykVChITx5kqBoGkzfz8iZg
Balgair 5y ago
> I am of the surprisingly-controversial opinion that ML’s future is going to be as a human empowerment tool — a bicycle for the mind, yet so much more. In chess, these players are called centaurs. Per my limited knowledge of the current chess meta, they are considered to be much better than either people or AI in isolation. https://en.wikipedia.org/wiki/Advanced_chess https://en.wikipedia.org/wiki/Advanced_chess
- deleted 5y ago
  [deleted]
- sillysaurusx 5y ago
  Heck yeah, thank you! It's delightful that there's a name for it, because it seems like the first people to become centaurs in their day to day lives will have a massive advantage over those that want the purity of unguided AI. I was eagerly hoping for a video of a centaur vs centaur tournament, but there seem to be none. https://www.youtube.com/results?search_query=centaur+chess https://www.youtube.com/results?search_query=centaur+chess At least, not yet. Maybe someone could do a tournament with https://www.twitch.tv/gmnaroditsky https://www.twitch.tv/gmnaroditsky or https://www.twitch.tv/gmhikaru https://www.twitch.tv/gmhikaru? Actually, the Gotham Chess guy might: https://www.youtube.com/watch?v=O1b-cuPDBZo&list=PLBRObSmbZluRH5GNp2gBxuxxItplWml17&index=2&ab_channel=GothamChess https://www.youtube.com/watch?v=O1b-cuPDBZo&list=PLBRObSmbZl... He's always looking for new angles for his Youtube channel. Centaurism isn't applicable to every situation -- Starcraft's AI kicks the butts of every pro player, because you can scale up and overwhelm your opponent. But there are often already humans in the mix, in these models. The humans are just designing the loss functions or deciding what to model, rather than using the results. So it's a "delayed" mechanical turk in that sense. When done right, it's so effective that it feels like cheating^Wthe future: https://twitter.com/theshawwn/status/1182208124117307392 https://twitter.com/theshawwn/status/1182208124117307392 Those are some of the nicest Stylegan outputs I've ever made. (Uh, do me a favor and ignore the Zeus one...) Each of them were crafted. The process was to start with something, and that "something" often didn't need to be anything close. For example, if the photo is an old man, but stylegan's showing a kid, you turn up the "age" slider. Do that for every feature; it felt like the character creation screen in fallout. Amazed it isn't an app yet. Artbreeder is nice, but it's not the same -- the key component was to have Peter Baylies' (follow him! https://twitter.com/pbaylies https://twitter.com/pbaylies) reverse encoder as a button you can press. Whenever the model gets too far from what you're thinking, you press it, and it morphs the face back closer to the target photo. In the process, it might distort the age slightly, or make the chin a little bigger, but it's an anchor at sea; it's why you can nail your final result, every time. I predict Centaurism might be popularized by gamedev. It's going to be pretty neat when some studio trains an RL algorithm vs someone's heart rate. Higher heart rate = more enjoyment, lots of the time, so you'd end up with either the funnest game or the scariest game you've ever seen. Probably a decade away from that though.

Iv 5y ago

The whole point of running such a stand is to get high quality data from players and make the AI learn from them. You don't 'patch' a reinforcement learning model, you just give it data to train on.

deleted 5y ago

[deleted]

tester34 5y ago

""AI"" will probably never be good in games like Dota2, League of Legends they're way too complex, even in above mentioned example it was 1vs1, meanwhile in general those games are 5vs5 (lol at least)

drdeca 5y ago
Never is a long time (...hopefully) Not too long ago, I think some people would have said the same about go.
- tester34 5y ago
  the difference is that e.g lol constantly changes and you'd have to relearn significant part of game every iirc 2 weeks also those games are waaaaaaaaay more complex than e.g chess I guess we'd need giant advance in computational power in order to analyze hundreds of thousands of matches
jjcm 5y ago
I'm sorry but this is just incorrect - OpenAI beat the previous year's champions in a 5v5 match the year after the 1v1 debut: https://www.youtube.com/watch?v=pkGa8ICQJS8 https://www.youtube.com/watch?v=pkGa8ICQJS8 There were restrictions / rules on the game (only a pool of 18 heroes were allowed), but they they won both games in a best of 3. You can see the progression / evolution of the training of the AI here: https://openai.com/projects/five/ https://openai.com/projects/five/ It's definitely doable to train them to be good at extremely complex games like Dota / League, it's just that the resource requirements to train the engine are significant. After the bots were opened to the public, they had a 99.4% win rate against pubs, even accounting for cheese strats.
- dpatterbee 5y ago
  It's worth mentioning that the restrictions they placed on the game were enormous, to the point that the human players were almost playing a different game. It certainly beat OG in many aspects, but the beauty of dota is the ability to adapt in the game with different strategies, strategies which weren't possible with the restrictions.