5 ms·
Agree. Also, with respect to training, what is the goal that we are maximizing? LLMs are easy, predicting the next word and we have lots of training data. But w
by ryeguy_24 1y ago
Agree. Also, with respect to training, what is the goal that we are maximizing? LLMs are easy, predicting the next word and we have lots of training data. But what are we training for in real world? Modeling the next spatial photograph to predict things that will happen next? It’s not intuitive to me what that objective function would be in spatial intelligence.
- curiouscavalier 1y agoOr that there is a sufficiently generalizable objective function for all “spatial intelligence.”
- kadushka 1y agoWhy wouldn’t predicting the next frame in a video stream be as effective as predicting the next word?