6 ms·

Another day, another hn thread of "this model changes everything" followed immediately by a reply stating "actually I have the literal opposite experience and f

by jahsome 7mo ago

Another day, another hn thread of "this model changes everything" followed immediately by a reply stating "actually I have the literal opposite experience and find competitor's model is the best" repeated until it's time to start the next day's thread.

clhodapp 7mo ago
And of course the benchmarks are from the school of "It's better to have a bad metric than no metric", so there really isn't any way to falsify anyone's opinions...
malshe 7mo ago
This pretty accurately summarizes all the long discussions about AI models on HN.
wasmainiac 7mo ago
[flagged]
- BoredPositron 7mo ago
  When you keep his ramblings on twitter or company blog in mind I bet he is a shit poster here.
- locknitpicker 7mo ago
  > All anonymous as well. Who are making these claims? script kiddies? sr devs? Altman? You can take off your tinfoil hat. The same models can perform differently depending on the programming language, frameworks and libraries employed, and even project. Also, context does matter, and a model's output greatly varies depending on your prompt history.
  - andrepd 7mo ago
    It's hardly tinfoil to understand that companies riding a multi-trillion dollar funding wave would spend a few pennies astroturfing their shit on hn. Or overfit to benchmarks that people take as objective measurements.
- nocman 7mo ago
  > Who are making these claims? script kiddies? sr devs? Altman? AI agents, perhaps? :-D
cactusplant7374 7mo ago
Hourly occurrence on /r/codex. Model astrology is about the vibes.
StephenHerlihyy 7mo ago
What amazes me the most is the speed at which things are advancing. Go back a year or even a year before that and all these incremental improvements have compounded. Things that used to require real effort to consistently solve, either with RAGs, context/prompt engineering, have become… trivial. I totally agree with your point that each step along the way doesn’t necessarily change that much. But in the aggregate it’s sort of insane how fast everything is moving.
- Rudybega 7mo ago
  The denial of this overall trend on here and in other internet spaces is starting to really bother me. People need to have sober conversations about the speed of this increase and what kind of effects it's going to have on the world.
  - deleted 7mo ago
    [deleted]
  - szundi 7mo ago
    [dead]
  - theLiminator 7mo ago
    Yeah, I really didn't believe in agentic coding until December, that was where it took off from being slightly more useful than hand crafting code to becoming extremely powerful.
  - girvo 7mo ago
    The effects when extrapolated out aren’t good, IMO. Certainly bad for me, a mid 30s software engineer who’s been doing this for nearly 20 years…
SatvikBeri 7mo ago
I use Claude Code every day, and I'm not certain I could tell the difference between Opus 4.5 and Opus 4.0 if you gave me a blind test

by jahsome 7mo ago

clhodapp 7mo ago

And of course the benchmarks are from the school of "It's better to have a bad metric than no metric", so there really isn't any way to falsify anyone's opinions...

malshe 7mo ago

This pretty accurately summarizes all the long discussions about AI models on HN.

wasmainiac 7mo ago

[flagged]

BoredPositron 7mo ago
When you keep his ramblings on twitter or company blog in mind I bet he is a shit poster here.
locknitpicker 7mo ago
> All anonymous as well. Who are making these claims? script kiddies? sr devs? Altman? You can take off your tinfoil hat. The same models can perform differently depending on the programming language, frameworks and libraries employed, and even project. Also, context does matter, and a model's output greatly varies depending on your prompt history.
- andrepd 7mo ago
  It's hardly tinfoil to understand that companies riding a multi-trillion dollar funding wave would spend a few pennies astroturfing their shit on hn. Or overfit to benchmarks that people take as objective measurements.
nocman 7mo ago
> Who are making these claims? script kiddies? sr devs? Altman? AI agents, perhaps? :-D

cactusplant7374 7mo ago

Hourly occurrence on /r/codex. Model astrology is about the vibes.

StephenHerlihyy 7mo ago

What amazes me the most is the speed at which things are advancing. Go back a year or even a year before that and all these incremental improvements have compounded. Things that used to require real effort to consistently solve, either with RAGs, context/prompt engineering, have become… trivial. I totally agree with your point that each step along the way doesn’t necessarily change that much. But in the aggregate it’s sort of insane how fast everything is moving.

Rudybega 7mo ago
The denial of this overall trend on here and in other internet spaces is starting to really bother me. People need to have sober conversations about the speed of this increase and what kind of effects it's going to have on the world.
- deleted 7mo ago
  [deleted]
- szundi 7mo ago
  [dead]
- theLiminator 7mo ago
  Yeah, I really didn't believe in agentic coding until December, that was where it took off from being slightly more useful than hand crafting code to becoming extremely powerful.
- girvo 7mo ago
  The effects when extrapolated out aren’t good, IMO. Certainly bad for me, a mid 30s software engineer who’s been doing this for nearly 20 years…

SatvikBeri 7mo ago

I use Claude Code every day, and I'm not certain I could tell the difference between Opus 4.5 and Opus 4.0 if you gave me a blind test