9 ms·

I miss the old Claude Code

38 points by akras14 22d ago

Dathuil 22d ago
My first deep dive with Claude Code was in Jan of this year. I was working on rebuilding an old city builder game from the the 00s and was trying to parse the original images from the game files. There was plenty if info on the structure online so I said I'd let Claude give it a go. I was running one of the sonnets I think. After about 5 prompts I had a web interface that I could drag the files into and it presented me a grid of all the images and I was able to export more common sprite sheets. Whole thing took maybe 10-15min and my mind was blown. I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work. Something has definetly changed in relation to how much pre work the newer models are doing and maybe it's by design for more consistant results.
- Flavius 22d ago
  > I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work Claude used to run at ~150tps in January. Now it runs at 50tps if you're lucky. That explains most of the speed issues without even getting into technical details about the new models.
  - Dathuil 22d ago
    Oh that's interesting. When did that happen? a 3x reduction in speed would probably explain it
    - Flavius 22d ago
      It happened as their user base exploded and their infrastructure could not keep up with all the new demand.
- jeffybefffy519 22d ago
  Not commenting on speed, but it seems models and their harnesses have generally gotten much worse over time. My suspicion is that the "Frontier" labs really dont have a strong handle on good quality evals that equal expectations of their users, so they just churn out new models for marketing to sell the shit out of. Recently cancelled my Codex subscription because I cannot stand 5.6-sol/terra/luna. On top of that, Codex the harness is just so dammed buggy in VS Code. I just discovered https://tinfoil.sh https://tinfoil.sh, which is fully private and attestable AI which works amazing with Kilo Code. Its costing me at API prices but for cheaper to run models which so far feel more consistent then what I get from frontier models.
  - bertshim 22d ago
    [dead]
  - packetlost 22d ago
    As someone working in this space: unless they're a very big player with resources to create custom hardware, afaik there's no way to actually prevent the GPU host from seeing the request content. There's no "secure enclave" that sits between a CPU and the GPU, the decrypted payload must necessarily hit system RAM, as would the output. They are, at best, running in TEE VMs which are also pretty horribly broken and don't provide the security that they say they do. Tinfoil is almost certainly lying to you.
    - jeffybefffy519 21d ago
      You sure? These links are directly from tinfoil.sh's technology page: https://tinfoil.sh/technology https://tinfoil.sh/technology They use these technologies: - https://www.nvidia.com/en-us/data-center/solutions/confidential-computing/ https://www.nvidia.com/en-us/data-center/solutions/confident... - https://www.amd.com/en/developer/sev.html https://www.amd.com/en/developer/sev.html - https://www.intel.com/content/www/us/en/products/details/processors/xeon/features/trust-domain-extensions.html https://www.intel.com/content/www/us/en/products/details/pro... Specifically, the intel page says "Intel® Xeon® 6 processors with Performance‑cores support Intel® TDX Connect technology, enabling confidential computing across the CPU and connected devices including GPUs, Smart NICs, and storage." which you are claiming do not exist.... Not trying to be an evangelist for them, but they seem to pretty open about their tech stack which is hugely differentiating compared to every other AI company....
- lenkite 20d ago
  Is this because of "model collapse" ? Newer AI models being trained on too much AI slop ?
setnone 22d ago
it won me over at 4.6 and lost at 4.7 and the image 'How multiagent turf war runs ended' [0] might explain the shift in the behaviour [0] https://www.anthropic.com/research/multiagent-systems https://www.anthropic.com/research/multiagent-systems
- akras14 22d ago
  I too keep setting Opus 4.6 manually in my daily work (when I am not using older Sonnet).
datakan 22d ago
Seems the site is down
- akras14 22d ago
  Fixed now, thank you.
latentsea 22d ago
I miss humans.
theowaway213456 22d ago
Site is broken: "Error establishing a database connection"
- kodoman 22d ago
  If only old claude was here to fix it.
  - akras14 22d ago
    It did help eventually :)
- bouke 22d ago
  https://web.archive.org/web/20260826063455/https://alexkras.com/focus-is-the-main-feature-why-i-miss-the-old-claude-code/ https://web.archive.org/web/20260826063455/https://alexkras....
  - akras14 22d ago
    Thank you!
- akras14 22d ago
  Fixed now, I did use Opus 5 to help me fine tune it :) Will probably follow up with another blog post about that soon.
naniel 22d ago
Fable is quite good, but i also noticed that the later opus models don't seem quite as effective as before. We break down our tasks pretty granularly before they get picked up by a model, and for that workflow we've found that sonnet 4 and opus 4 are still quite effective, and debatably more effective than the 5s for reference, we use n-dx (https://n-dx.dev https://n-dx.dev) for our workflow
gorayobi 22d ago
I do too. In the past couple of months it's just doing too much. Before it was prompt -> model writes code -> done, I check the work. Now it's prompt -> model seems to read the entire codebase to 'get the full picture' -> takes forever to write code -> runs a whole bunch of things to verify the result. It seems like they have optimized the harness more and more for people who don't know what they are doing or what they want. I know what I want. I mostly want to 10x my typing, I already know what I want and what files to edit and how to verify the result.
- akras14 22d ago
  Yes, author here. I was thinking about it more after the post. I wonder if the harness has a bigger share of blame here than the model itself. I seem to like using Opus 5 in the browsers a lot more... I.e. it was very helpful in fine-tuning my site after it went down due to HN traffic.
TYPE_FASTER 22d ago
We all do.
heliskyr2 22d ago
[flagged]

38 points by akras14 22d ago

My first deep dive with Claude Code was in Jan of this year. I was working on rebuilding an old city builder game from the the 00s and was trying to parse the original images from the game files. There was plenty if info on the structure online so I said I'd let Claude give it a go. I was running one of the sonnets I think. After about 5 prompts I had a web interface that I could drag the files into and it presented me a grid of all the images and I was able to export more common sprite sheets. Whole thing took maybe 10-15min and my mind was blown. I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work. Something has definetly changed in relation to how much pre work the newer models are doing and maybe it's by design for more consistant results.

Flavius 22d ago
> I have tried to do the same recently with the newer models and we're still not writing code by the time the older models had finished their work Claude used to run at ~150tps in January. Now it runs at 50tps if you're lucky. That explains most of the speed issues without even getting into technical details about the new models.
- Dathuil 22d ago
  Oh that's interesting. When did that happen? a 3x reduction in speed would probably explain it
  - Flavius 22d ago
    It happened as their user base exploded and their infrastructure could not keep up with all the new demand.
jeffybefffy519 22d ago
Not commenting on speed, but it seems models and their harnesses have generally gotten much worse over time. My suspicion is that the "Frontier" labs really dont have a strong handle on good quality evals that equal expectations of their users, so they just churn out new models for marketing to sell the shit out of. Recently cancelled my Codex subscription because I cannot stand 5.6-sol/terra/luna. On top of that, Codex the harness is just so dammed buggy in VS Code. I just discovered https://tinfoil.sh https://tinfoil.sh, which is fully private and attestable AI which works amazing with Kilo Code. Its costing me at API prices but for cheaper to run models which so far feel more consistent then what I get from frontier models.
- bertshim 22d ago
  [dead]
- packetlost 22d ago
  As someone working in this space: unless they're a very big player with resources to create custom hardware, afaik there's no way to actually prevent the GPU host from seeing the request content. There's no "secure enclave" that sits between a CPU and the GPU, the decrypted payload must necessarily hit system RAM, as would the output. They are, at best, running in TEE VMs which are also pretty horribly broken and don't provide the security that they say they do. Tinfoil is almost certainly lying to you.
  - jeffybefffy519 21d ago
    You sure? These links are directly from tinfoil.sh's technology page: https://tinfoil.sh/technology https://tinfoil.sh/technology They use these technologies: - https://www.nvidia.com/en-us/data-center/solutions/confidential-computing/ https://www.nvidia.com/en-us/data-center/solutions/confident... - https://www.amd.com/en/developer/sev.html https://www.amd.com/en/developer/sev.html - https://www.intel.com/content/www/us/en/products/details/processors/xeon/features/trust-domain-extensions.html https://www.intel.com/content/www/us/en/products/details/pro... Specifically, the intel page says "Intel® Xeon® 6 processors with Performance‑cores support Intel® TDX Connect technology, enabling confidential computing across the CPU and connected devices including GPUs, Smart NICs, and storage." which you are claiming do not exist.... Not trying to be an evangelist for them, but they seem to pretty open about their tech stack which is hugely differentiating compared to every other AI company....
lenkite 20d ago
Is this because of "model collapse" ? Newer AI models being trained on too much AI slop ?

setnone 22d ago

it won me over at 4.6 and lost at 4.7 and the image 'How multiagent turf war runs ended' [0] might explain the shift in the behaviour [0] https://www.anthropic.com/research/multiagent-systems https://www.anthropic.com/research/multiagent-systems

akras14 22d ago
I too keep setting Opus 4.6 manually in my daily work (when I am not using older Sonnet).

datakan 22d ago

Seems the site is down

akras14 22d ago
Fixed now, thank you.

latentsea 22d ago

I miss humans.

theowaway213456 22d ago

Site is broken: "Error establishing a database connection"

kodoman 22d ago
If only old claude was here to fix it.
- akras14 22d ago
  It did help eventually :)
bouke 22d ago
https://web.archive.org/web/20260826063455/https://alexkras.com/focus-is-the-main-feature-why-i-miss-the-old-claude-code/ https://web.archive.org/web/20260826063455/https://alexkras....
- akras14 22d ago
  Thank you!
akras14 22d ago
Fixed now, I did use Opus 5 to help me fine tune it :) Will probably follow up with another blog post about that soon.

naniel 22d ago

Fable is quite good, but i also noticed that the later opus models don't seem quite as effective as before. We break down our tasks pretty granularly before they get picked up by a model, and for that workflow we've found that sonnet 4 and opus 4 are still quite effective, and debatably more effective than the 5s for reference, we use n-dx (https://n-dx.dev https://n-dx.dev) for our workflow

gorayobi 22d ago

I do too. In the past couple of months it's just doing too much. Before it was prompt -> model writes code -> done, I check the work. Now it's prompt -> model seems to read the entire codebase to 'get the full picture' -> takes forever to write code -> runs a whole bunch of things to verify the result. It seems like they have optimized the harness more and more for people who don't know what they are doing or what they want. I know what I want. I mostly want to 10x my typing, I already know what I want and what files to edit and how to verify the result.

akras14 22d ago
Yes, author here. I was thinking about it more after the post. I wonder if the harness has a bigger share of blame here than the model itself. I seem to like using Opus 5 in the browsers a lot more... I.e. it was very helpful in fine-tuning my site after it went down due to HN traffic.

TYPE_FASTER 22d ago

We all do.

heliskyr2 22d ago

[flagged]