not having any body, continuous sensory input (except ChatGPT-live gets streaming audio), episodic memory, on-the-job learning (live weight updates), any live f

not having any body, continuous sensory input (except ChatGPT-live gets streaming audio), episodic memory, on-the-job learning (live weight updates), any live feedback loops (like moving a motor updates proprioperception or turning physically changes what a streaming camera sees), really hurts these models' abilities to perform tasks of the kind you're waiting for. They are very good at instruction-following and you can teach it a new task that fits in its context and it'll learn it and do it. Go ahead, you can make up some new brand new ruleset or behavior and instruct it to follow it and it will. That's amazing. But it won't be any better at its new behavior after an hour or ten hours or ten days. It doesn't have the kind of adaptation that we expect. What it is able to do already is pretty amazing, but what it lacks is also a great hindrance to seeing its full capabilities. We just have to wait until research labs add these missing components.