6 ms·

Any attempt at world modeling using today's LLMs needs to have a goal function for the LLM to optimize. The LLM needs to build, evaluate and update it's model o

by hrn_frs 7mo ago

Any attempt at world modeling using today's LLMs needs to have a goal function for the LLM to optimize. The LLM needs to build, evaluate and update it's model of the world. Personally, the main obstacle I found is in updating the model: Data can be large and I think that LLMs aren't good at finding correlations.

ethbr1 7mo ago
Isn't that just RL with extra power-intensive steps? (An entire model chugging away in the goal function)
- hrn_frs 7mo ago
  That's correct, but if successful you'd essentially have updated the LLM's knowledge and capabilities "on the fly".
  - ethbr1 7mo ago
    Maybe we could run off-peak load of that nature, when power is cheaper. Call it dreaming. ;)