7 ms·
I assume using this large of a context window instead of RAG would mean the consumption of many orders of magnitude more GPU.
by kylerush 3y ago
I assume using this large of a context window instead of RAG would mean the consumption of many orders of magnitude more GPU.