4 ms·
They have updated it
by frozeus 3mo ago
They have updated it
- LUmBULtERA 3mo agoDid Anthropic have Opus 4.8 and Sonnet 5 switched in the Agentic Search chart at first?
- fluidcruft 3mo agoNo, and the original had everything more expensive. There's a comparison here: https://www.reddit.com/r/ClaudeAI/comments/1ukgqwr/looks_like_anthropic_quietly_updated_the_sonnet_5/ https://www.reddit.com/r/ClaudeAI/comments/1ukgqwr/looks_lik... The explanation Anthropic gave for the update doesn't address how the x-axis needed to range up to $50 previously and only $10 now. In any case the pass rates are also lower. Probably the difference between whatever it is people notice when they say models become "nerfed".
- LUmBULtERA 3mo agoHuh, super interesting. Thanks!
- theptip 3mo agoHa! So we were not looking at the same chart. That makes more sense. > Anthropic did post an official explanation, stating the original chart used a "simpler methodology" that "underestimated Sonnet 5's performance." The new chart supposedly uses their "standard methodology." Oops!