5 ms·
We're getting very solid results. Instead of performing rag on the (vectorised) raw source texts, we create representations of elements/"context clusters" cont
by inductive_magic 3y ago
We're getting very solid results.
Instead of performing rag on the (vectorised) raw source texts, we create representations of elements/"context clusters" contained within the source, which are then vectorised and ranked. That's all I can disclose, hope that helps.
- Merik 3y agoThanks for your message. I should say that giving your comment to GPT-4, with a request for a solution architecture that could produce good results based on the comment, produced a very detailed, fascinating solution. https://chat.openai.com/share/435a3855-bf02-4791-97b3-4531b8e925ec https://chat.openai.com/share/435a3855-bf02-4791-97b3-4531b8...
- weird-eye-issue 3y agoA whole lot of noise
- Merik 3y agoMaybe, but it expanded on the idea in the vague comment and together introduced me to the idea of embedding each sentence and then clustering the sentences, then taking the centroid of the sentences as the embedding to index/search against. I had not thought of doing that before.
- isoprophlex 3y agoIf only the thing could speak and summarize in plain English instead of hollow, overly verbose bulleted lists.
- falling_myshkin 3y agoAfter seeing raw source text performance, I agree that representational learning of higher-level semantic "context clusters" as you say seems like an interesting direction.
- reerdna 3y agoSounds a little like this recent paper; "RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval" https://arxiv.org/abs/2401.18059 https://arxiv.org/abs/2401.18059