6 ms·
That's not what RAG is. RAG is the process of adding relevant information to a prompt in an LLM. It's a form of in-context learning.
by ozr 2y ago
That's not what RAG is. RAG is the process of adding relevant information to a prompt in an LLM. It's a form of in-context learning.
- mr_toad 2y agoIt’s right there in the name - first you Retrieve relevant information (often a vector lookup) then you use it to Augment the prompt, then you Generate an answer. It’s bloody useful if you can’t cram your entire proprietary code base into a prompt.
- kergonath 2y agoWhat makes it useful is precisely that it is not learning.
- ozr 2y agoYes it is; it's just not updating the weights. https://ai.stanford.edu/blog/understanding-incontext/ https://ai.stanford.edu/blog/understanding-incontext/