6 ms·
I've been using it with `/effort max` all the time, and it's been working better than ever. I think here's part of the problem, it's hard to measure this, and
by cube2222 5mo ago
I've been using it with `/effort max` all the time, and it's been working better than ever.
I think here's part of the problem, it's hard to measure this, and you also don't know in which AB test cohorts you may currently be and how they are affecting results.
- siegers 5mo agoAgree. I keep effort max on Claude and xhigh on GPT for all tasks and keep tasks as scoped units of work instead of boil the ocean type prompts. It is hard to measure but ultimately the tasks are getting completed and I'm validating so I consider it "working as expected".
- bryanlarsen 5mo agoIt works better, until you run out of tokens. Running out of tokens is something that used to never happen to me, but this month now regularly happens. Maybe I could avoid running out of tokens by turning off 1M tokens and max effort, but that's a cure worse than the disease IMO.
- cube2222 5mo agoI would risk a guess that people have a wrong intuition about the long-context pricing and are complaining because of that. Yeah, the per-token price stays the same, even with large context. But that still means that you're spending 4x more cache-read tokens in a 400k context conversation, on each turn, than you would be in a 100k context conversation.
- rimliu 5mo agounless you always have run it on effort max, and see that it degraded.