6 ms·

Are there any agentic models like this that would work for controlling input in arbitrary video games? I've been wanting to have an AI play Kerbal Space Program

by codezero 10mo ago

Are there any agentic models like this that would work for controlling input in arbitrary video games? I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious.

jauntywundrkind 10mo ago
I might suggest looking at Alibaba's open source AgentEvolver. It doesn't specifically target video games, but it's an agentic system designed around a more OODA loop evolutionary system than the kind of train/inference system, has potential, could be exciting to see. I like how they classifythr sub problems of their work. Environment/ self questioning -> task / self questioning -> trajectory / self evaluation. OODA-esque. https://arxiv.org/abs/2511.10395 https://arxiv.org/abs/2511.10395 https://github.com/modelscope/AgentEvolver https://github.com/modelscope/AgentEvolver with thanks to Sung Kim who has been a great feed https://bsky.app/profile/sungkim.bsky.social/post/3m5xkgttk3k2b https://bsky.app/profile/sungkim.bsky.social/post/3m5xkgttk3...
wmf 10mo ago
https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/ https://deepmind.google/blog/sima-2-an-agent-that-plays-reas... (not a local model)
lawlessone 10mo ago
i'm curious what would happen if you got it to play online poker...
serf 10mo ago
> I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious. people have been experimenting with this since early Opus days. Check out kRPC. Get it running (or make your agent get it running) and it's trivial for any of the decent models to interface with it When I tried it with Opus3 I got a lot of really funny urgent messages during failures like "There has been an emergency, initiating near-real-time procedures for crew evacuation.." and then it's just de-couple every stage and ram into the ground. Makes for a fun ant-farm to watch though. [0]: https://krpc.github.io/krpc/ https://krpc.github.io/krpc/

jauntywundrkind 10mo ago

I might suggest looking at Alibaba's open source AgentEvolver. It doesn't specifically target video games, but it's an agentic system designed around a more OODA loop evolutionary system than the kind of train/inference system, has potential, could be exciting to see. I like how they classifythr sub problems of their work. Environment/ self questioning -> task / self questioning -> trajectory / self evaluation. OODA-esque. https://arxiv.org/abs/2511.10395 https://arxiv.org/abs/2511.10395 https://github.com/modelscope/AgentEvolver https://github.com/modelscope/AgentEvolver with thanks to Sung Kim who has been a great feed https://bsky.app/profile/sungkim.bsky.social/post/3m5xkgttk3k2b https://bsky.app/profile/sungkim.bsky.social/post/3m5xkgttk3...

wmf 10mo ago

https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/ https://deepmind.google/blog/sima-2-an-agent-that-plays-reas... (not a local model)

lawlessone 10mo ago

i'm curious what would happen if you got it to play online poker...

serf 10mo ago

> I've been wanting to have an AI play Kerbal Space Program because I think it would just be pretty hilarious. people have been experimenting with this since early Opus days. Check out kRPC. Get it running (or make your agent get it running) and it's trivial for any of the decent models to interface with it When I tried it with Opus3 I got a lot of really funny urgent messages during failures like "There has been an emergency, initiating near-real-time procedures for crew evacuation.." and then it's just de-couple every stage and ram into the ground. Makes for a fun ant-farm to watch though. [0]: https://krpc.github.io/krpc/ https://krpc.github.io/krpc/