5 ms·
If that was true then Anthropic would have built this functionality in themselves.
by OccamsMirror 2mo ago
If that was true then Anthropic would have built this functionality in themselves.
- brookst 2mo agoThey did. On any long running query with large context, tell Claude “give me a status report every 4 minutes to keep the cache warm”. It’s entirely happy to oblige and usually says “good idea, that will keep costs down”