18 ms·
Grow your OpenAI bill exponentially with this one easy trick! In all seriousness — looks nifty! Do you guys have any plans to bring suggestion latency down fro
by AYoung010 3y ago
Grow your OpenAI bill exponentially with this one easy trick!
In all seriousness — looks nifty! Do you guys have any plans to bring suggestion latency down from what’s show in the demo?
- swiftlyTyped 3y agoLatency is actually very low as-is, with GPT-4-Turbo! But other than that, yes, we do have plans - using real-time RAG. I carried out some research with incredibly promising results https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-accuracy-cost https://ai88.substack.com/p/rag-vs-context-window-in-gpt4-ac...