5 ms·
They still aren't learning. You're learning and then telling them to incorporate your learnings. They aren't able to remember this so you need to remind them ea
by Clent 10mo ago
They still aren't learning. You're learning and then telling them to incorporate your learnings. They aren't able to remember this so you need to remind them each day.
That sounds a lot like '50 First Dates' but for programming.
- embedding-shape 10mo ago> They aren't able to remember this Yes, this is something people using LLMs for coding probably pick up on the first day. They're not "learning" as humans do obviously. Instead, the process is that you figure out what was missing from the first message you sent where they got something wrong, change it, and then restart from beginning. The "learning" is you keeping track of what you need to include in the context, how that process exactly works, is up to you. For some it's very automatic, and you don't add/remove things yourself, for others is keeping a text file around they copy-paste into a chat UI. This is what people mean when they say "you can kind of do "learning" (not literally) for LLMs"
- averageRoyalty 10mo agoThat is true, but does it actually matter if the outcome is the same? GP is saying they don't need to remind them.
- troupo 10mo agoThe outcome is definitely not the same, and you need to remind them all the time. Even if you feed the context automatically they will happily "forget" it from time to time. And you need to update that automated context again, and again, and again, as the project evolves
- latentsea 10mo ago50 first new Date()
- bloppe 10mo agoWhile I hate anthropomorphizing agents, there is an important practical difference between a human with no memory, and an agent with no memory but the ability to ingest hundreds of pages of documentation nearly instantly.
- Sammi 10mo agoThey document how to do something they just figured out. They store/memorise it in a file. It's functionally working the same as learning. If you look at it like a black box, then you can't tell the difference from the input and output.
- _flux 10mo agoI believe LLMs ultimately cannot learn new ideas from their input in the same way as they can learn it from their training data, as the input data doesn't affect the weights of the neural network layers. For example, let's say LLMs did not have examples of chess gameplay examples in their training data. Would one be able to have an LLM play chess by listing the rules and examples in the context? Perhaps, to some extent, but I believe it would be much worse than if it was part of the training (which of course isn't great either).