8 ms·
That’s awesome! Now have it mark blocks of text on or off, so it can ignore irrelevant, or worse erroneous material — no need to include it in the context wind
by transfire 1y ago
That’s awesome!
Now have it mark blocks of text on or off, so it can ignore irrelevant, or worse erroneous material — no need to include it in the context window.
- pkoird 1y agoBack to TF IDF we go.
- knuppar 1y agoOne could argue TF-IDF is a case of an attention layer... but not quadratic in inference/training and kinda just a quotient. Yeah maybe we should go back
- codelion 1y agoThis sounds like an interesting idea, can you elaborate more may be with a concrete example. I am wondering if this can be implemented easily as a plugin in optillm.