6 ms·
LLM based autonomous agents remind me a lot of Leonard from the movie Memento. In the movie, Leonard is trying desperately to find the murderer of his wife, bu
by crosen99 3y ago
LLM based autonomous agents remind me a lot of Leonard from the movie Memento. In the movie, Leonard is trying desperately to find the murderer of his wife, but he has one big problem - he can no longer build new memories. So, he needs to develop a system for storing new knowledge and then retrieving the relevant bits every time he formulates a plan for what to do next. Throughput the movie, Leonard makes a number of missteps because his system for recording and retrieving knowledge from this external memory system is imperfect. The movie is very well done.
- cs702 3y agoThis is a brilliant analogy.[a] It does a really good job of conveying the fact that current LLMs have a horrendously inefficient method for achieving something resembling working+long-term memory: They need someone else to write code that * stores in advance all possible pieces of text that might be be relevant to future prompts; * finds and retrieves at runtime the pieces of text that are supposedly most relevant to a prompt; and * tacks on those supposedly most relevant pieces of text as a contextual preamble to each new prompt (query). Current LLMs truly are Leonard-Like Models. Surely there must be a better way... but it hasn't been discovered yet. -- [a] I saw "Memento" years ago and still remember it vividly. It was written and directed by a young Christopher Nolan.
- shkurski_ 3y agoExactly! What could be the next step is removing the (user-facing) prompt at all, since (presumably) there should be enough data for this part to be proactive.