6 ms·
For anyone who actually tried it : Does it respects/builds some kind of game map in the process or is it just a bizarre psychedelic dream walk experience where
by croo 2y ago
For anyone who actually tried it :
Does it respects/builds some kind of game map in the process or is it just a bizarre psychedelic dream walk experience where you cannot go back the same place twice and space dimensions are just funny? Is a game map finite?
- delusional 2y agoJust tried it out, and no. It doesn't have any sort of "map" awareness. It's very much in the "recall/replay" category of "AI" where it seems to accurately recall stuff that is part of the training dataset, but as soon as you do something not in there (like walk into a wall), it completely freaks out and spits out gibberish. Plausible gibberish, but gibberish none the less.
- neongreen 2y agoCan you upload a screen recording? I don’t think I can run the model locally but it’d be super interesting to see what happens if you run into a wall
- kqr 2y agoThis should mainly be a matter of giving it more training though, right? It sounds like to amount of training it's gotten is relatively sparse.
- treyd 2y agoIt doesn't have any ability to reason about what you did more than a couple of seconds ago. Its memory is what's currently on the screen and what the user's last few inputs were.
- delusional 2y agoTheoretically. In practice, that's not clear. As you add more training data you have to ask yourself what the point is. we already have a pretty good simulation of Counter Strike.
- aidos 2y agoJust skimmed the article but my guess is that it’s a dream type experience where if you turned around 180 and walked the other direction it wouldn’t correspond to where you just came from. More like an infinite map.
- lopuhin 2y agoI don't think so, what they show on CS video is exactly the Dust2 map, not just something similar/inspired by it.
- twic 2y agoIt's trained on moving around dust2, so as long as the previous frame was a view of dust2, the next frame is very likely to be a plausible subsequent view of dust2. In some sense, this encodes a map; but it's not what most people think of when they think about maps. I'd be interested to see what happens if you look down at your feet for a while, then back up. If the ground looks the same everywhere, do you come up in a random place?
- bohadi 2y agotried this irl and wound up here
- arendtio 2y agoIt probably depends on what you see. As long as you have a broad view over a part of the map, you should stay in that region, but I guess that if you look at a mono-color wall, you probably find yourself in a very different part of the map when you look around yourself again. But I am just guessing, and I haven't tried it yet.
- InsideOutSanta 2y agoJust looking at the first video, there's a section where structures just suddenly appear in front of the player, so this does not appear to build any kind of map, or have any kind of meaningful awareness of something resembling a game state. This is similar to LLM-based RPGs I've played, where you can pick up a sword and put it in your empty bag, and then pull out a loaf of bread and eat it.
- anal_reactor 2y ago> you can pick up a sword and put it in your empty bag, and then pull out a loaf of bread and eat it Mondays