5 ms·
Claude Opus can use a 1M context window but I’ve found it to degrade significantly past 250k in practice.
by plandis 5mo ago
Claude Opus can use a 1M context window but I’ve found it to degrade significantly past 250k in practice.
- marcus_holmes 5mo agoSeconded. I'm getting used to the changes that happen in the conversation now, and can work out when it's time for my little coding buddy to have a nap. And Opus is absolutely terrible at guessing how many tokens it's used. Having that as a number that the model can access itself would be a real boon.
- airstrike 5mo ago250k is still massively more than 100k and 1M prevents it from having to compact