8 ms·
Very large context windows (usually when you're working on a very large existing project) will chew through tokens quickly. So will RAG. If you're working on
by nostromo 2mo ago
Very large context windows (usually when you're working on a very large existing project) will chew through tokens quickly. So will RAG.
If you're working on isolated components within a system or small projects, you'll have a very different experience.