8 ms·
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
by jonas_scholz 2mo ago
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
- PaoloBarbolini 2mo agoThey confirmed on LinkedIn that they are working on it. Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-caching-to-reduce-input-tokens-cost https://feature-request.scaleway.com/posts/1251/prompt-cachi...