5 ms·
It would, probably, be cost prohibitive to use 10M context to it's fullest each time. I instead hope for to have an api to access to the context as a datastore
by dumbmachine 3y ago
It would, probably, be cost prohibitive to use 10M context to it's fullest each time.
I instead hope for to have an api to access to the context as a datastore, so like RAG we can control what to store but unlike rag all data stays within context.