5 ms·
Maybe I'm old but where exactly are the "dragons"? How is RAG any different from the search systems we've been building before LLMs? Is it the sudden need for
by nilirl 22d ago
Maybe I'm old but where exactly are the "dragons"?
How is RAG any different from the search systems we've been building before LLMs? Is it the sudden need for everyone to design a search API and engine that's driven this trend?
If so, I'd like to see more design patterns around existing search problems:
- Correcting or backtracking based on feedback.
- Measuring relevance.
- Comparison with task-based pre-written queries. Does every LLM task need a full blown search engine? Why not a tightly scoped domain API for data retrieval?
- TudorAndrei 22d agoIt's just information retrieval packaged as something new.
- kachnuv_ocasek 22d agoAnd you can't fundraise on some old "information retrieval".
- mdp2021 22d agoIt's just information retrieval through a new NN based technology that allows to map concepts and ideas as the compression of long text into points in a multidimensional space that manages to compress even more dimensions than the given ones, through non-transparent engines that give different mappings and results, and still (the information retrieval) requires many more clever tricks than the simple idea of vector distance ordering because things do not quite work as they should. Let's say it's just "computation packaged as something new". "Trivial things".
- brabel 22d agoThe whole embedding thing which converts “tokens” to vectors, which you then store in a vector database so that you can later query by vector distance, seems to be LLM specific technology, no? As far as I know the vectors look a lot like the weights in a LLM itself which is why the vector search also works with some level of intelligence.
- triangle 22d agoVector embeddings predate LLMs. They have been used as far back as the early 2000s. They are a general machine learning technique, rather than LLM specific
- ozim 22d agoUnfortunately LLMs made vector search more popular so it seems like something LLM specific. What makes it worse, a lot of people in the thread equate vector search with RAG, whereas RAG is the name for anything that model can query so a user doesn't have to copy/paste feed it to the model manually like access to text files is RAG.
- nilirl 22d agoSure and that's a new technique for indexing and querying. Where's the new design tension? Indexes always had to be monitored for freshness and queries have always needed cleaning or parsing.
- ewidar 22d agonot really, vectorising text/books is old school ML by this point. at least to me that seems the same as https://en.wikipedia.org/wiki/Word2vec https://en.wikipedia.org/wiki/Word2vec for e.g.
- Foobar8568 22d agoWell... Everything new is old "A vector space model for automatic indexing" 1975 - https://dl.acm.org/doi/10.1145/361219.361220 https://dl.acm.org/doi/10.1145/361219.361220
- esafak 22d agoI wonder who was doing doing semantic search in the last century! "The future is already here—It's just not very evenly distributed..."
- vintermann 22d ago
- MacketSWE 22d ago[flagged]