9 ms·
What I starting to hate is that each model's effort level can mean completely different power. Today sonnet 5's med level effort is equivalent to sonnet 4.6 lo
by alvis 3mo ago
What I starting to hate is that each model's effort level can mean completely different power.
Today sonnet 5's med level effort is equivalent to sonnet 4.6 low level effort :/
- deleted 3mo ago[deleted]
- nsingh2 3mo agoThat seems to only be true for the "Agentic Search" benchmark. That benchmark in particular is a bit weird, because Sonnet 4.6 effort levels had a relatively small effect, so Sonnet 5 med is basically comparable to all effort levels of Sonnet 4.6.