5 ms·
... so how do API users enable 1hr caching? I haven't found a setting anywhere.
by highd 5mo ago
... so how do API users enable 1hr caching? I haven't found a setting anywhere.
- g4cg54g54 5mo agowould like to know this too ;D there is env.ENABLE_PROMPT_CACHING_1H_BEDROCK - but that is - as the name says "when using Bedrock" for the raw API the docs are also clear -> "ttl": "1h" https://platform.claude.com/docs/en/build-with-claude/prompt-caching#ttl-support https://platform.claude.com/docs/en/build-with-claude/prompt... but how to make claude-code send that when paying by API-key? or when using a custom ANTHROPIC_BASE_URL? (requests will contain cache_control, but no ttl!)
- g4cg54g54 5mo agoseems we have been heard ;) 2.1.108 Added ENABLE_PROMPT_CACHING_1H env var to opt into 1-hour prompt cache TTL on API key, Bedrock, Vertex, and Foundry (ENABLE_PROMPT_CACHING_1H_BEDROCK is deprecated but still honored), and FORCE_PROMPT_CACHING_5M to force 5-minute TTL docs are not updated yet, directly from the changelog^ And this is "a bit better" - but seemingly still nowhere close to what subscribers get where main thread, agent, initial and follow-up messages may all get there own ?intelligent? 5min or 1h decision :/