21 ms·

Nice saying. If in the prediction "given [intricate analysis] the whole [shebang] goes [bust] at [date]", only the [date] turns out to be wrong, I'd say it is s

by rapnie 15d ago

Nice saying. If in the prediction "given [intricate analysis] the whole [shebang] goes [bust] at [date]", only the [date] turns out to be wrong, I'd say it is still a valuable prediction however, though it was wrong.

Dban1 15d ago
&&
dash2 15d ago
Problem is even his “intricate analysis” was wrong: for example he was saying the models wouldn’t keep improving… in 2024.
- pocksuppet 14d ago
  Have they improved? Is there evidence of that? Got a task you were doing in 2024 and 2026 and the results of each?
  - threatripper 14d ago
    There is plenty of evidence that they have improved in all benchmarks and also in my private experience. But have they improved in the things they still fail at? No, they still fail at them. You need only one example of failure to prove that it still fails. They still fail a lot on many real world tasks. So, depending on what you ask, they may have not improved even a tiny bit.
    - Denkel 11d ago
      I am a very light user, so this is my feeling from reading about other people's experience; I wouldn't say that they plateau'd but up to 4.5/4.8 the gains in the models felt exponential while since then they feel more linear and the big improvements are coming less from the models and more from everything around it (harnesses, agentic development, skills...). So, while I don't feel like there has not been improvement, it really feels like there is a limit that will be reached sooner than later (and for sure before any AGI).
  - anthonyrstevens 13d ago
    Oh my goodness. Is this really a good-faith question?
randallsquared 14d ago
Since almost everything eventually goes bust, I wouldn't agree that this was particularly valuable, unless the analysis proved out in other ways. It's like the saying that some economists have predicted 10 of the last 4 recessions. The analysis that leads to that prediction may or may not be valuable, but is only valuable if it predicts something, because otherwise how can you know it has any accuracy at all?

by rapnie 15d ago

Dban1 15d ago

dash2 15d ago

Problem is even his “intricate analysis” was wrong: for example he was saying the models wouldn’t keep improving… in 2024.

pocksuppet 14d ago
Have they improved? Is there evidence of that? Got a task you were doing in 2024 and 2026 and the results of each?
- threatripper 14d ago
  There is plenty of evidence that they have improved in all benchmarks and also in my private experience. But have they improved in the things they still fail at? No, they still fail at them. You need only one example of failure to prove that it still fails. They still fail a lot on many real world tasks. So, depending on what you ask, they may have not improved even a tiny bit.
  - Denkel 11d ago
    I am a very light user, so this is my feeling from reading about other people's experience; I wouldn't say that they plateau'd but up to 4.5/4.8 the gains in the models felt exponential while since then they feel more linear and the big improvements are coming less from the models and more from everything around it (harnesses, agentic development, skills...). So, while I don't feel like there has not been improvement, it really feels like there is a limit that will be reached sooner than later (and for sure before any AGI).
- anthonyrstevens 13d ago
  Oh my goodness. Is this really a good-faith question?

randallsquared 14d ago

Since almost everything eventually goes bust, I wouldn't agree that this was particularly valuable, unless the analysis proved out in other ways. It's like the saying that some economists have predicted 10 of the last 4 recessions. The analysis that leads to that prediction may or may not be valuable, but is only valuable if it predicts something, because otherwise how can you know it has any accuracy at all?