8 ms·
Care to give some pointers on what to look at? Looks like I will be doing something similar soon so that would be much appreciated
by spariev 1y ago
Care to give some pointers on what to look at? Looks like I will be doing something similar soon so that would be much appreciated
- CuriouslyC 1y agoJust ask chat gpt about state of the art in context pruning and other methods to optimize the context being provided to a LLM, it's a good research helper. The right mental model is that it's basically like RAG in reverse, instead of trying to select and rank from a data set, you're trying to select and rank from context given a budget.