6 ms·
Would like to see the latency and cost of parsing entire 10M context before throwing out the RAG stack which is relatively cheap and fast.
by chuckcode 3y ago
Would like to see the latency and cost of parsing entire 10M context before throwing out the RAG stack which is relatively cheap and fast.