6 ms·
Here's a mega guide on keeping costs low with LLMs - https://portkey.ai/blog/implementing-frugalgpt-smarter-llm-usage-for-lower-costs/ https://portkey.ai/blog/i
by roh26it 2y ago
Here's a mega guide on keeping costs low with LLMs - https://portkey.ai/blog/implementing-frugalgpt-smarter-llm-usage-for-lower-costs/ https://portkey.ai/blog/implementing-frugalgpt-smarter-llm-u...
tl;dr:
- Keep prompts short, combine prompts or make more detailed prompts but go to a smaller model
- Simple and semantic cache lookups
- Classify tasks and route to the best LLM using an AI gateway
Portkey.ai could help with a lot of this
- retrovrv 2y agocame across this guide earlier - valuable insights. thanks for sharing!