6 ms·
Openrouter was pretty great before prompt caching became common. Now it is extremely expensive for most individual workflows, unless you spend a lot of work cus
by irthomasthomas 22d ago
Openrouter was pretty great before prompt caching became common. Now it is extremely expensive for most individual workflows, unless you spend a lot of work customizing router preferences, and then you still get a worse cache hit rate than using the provider directly. I only keep $5-$10 in OR for occasional testing.
- dackdel 22d agodidnt stripe acquire open router? so i assumed its sunset.
- copperx 22d agoWhy is caching affected when not using the provider directly?
- irthomasthomas 20d agoI don't know. But take a look at https://openrouter.ai/deepseek/deepseek-v4-pro-0813#pricing https://openrouter.ai/deepseek/deepseek-v4-pro-0813#pricing for instance, where the deepseek provider shows an 85% cache hit rate, while the same one on zenmux is 98%.
- polski-g 22d agoUse the "only" header?
- irthomasthomas 20d agoSomething is off with them so that even using a locked provider does not deliver the same cache rate. See https://openrouter.ai/deepseek/deepseek-v4-pro-0813#pricing https://openrouter.ai/deepseek/deepseek-v4-pro-0813#pricing for instance where deepseek has 85% cache hit rate, and the same one on zenmux is 98%.