aszen

5 ms·

1.
by aszen 5d ago
Their zdr is not a concrete promise though, there's no way to verify that the provider is not storing the logs
2.
by aszen 14d ago
I was thinking the same, obvious suspicion is they benchmaxed it on older bench.
3.
by aszen 1mo ago
Because stronger models are harder to jailbreak from the paper it says haiku was easily fooled into giving us thinking contents
4.
by aszen 2mo ago
Won't surprise me if the llm just calls sleep after it's convinced it knows all
5.
by aszen 2mo ago
And does it actually use it
6.
by aszen 2mo ago
Is your plugin just skills or does it have custom agents? My own experience is that Claude will use your skills but will ignore your agents or custom search tools.
7.
by aszen 4mo ago
Claude code already fans out and sandboxes context by calling sub agents so I'm not sure this approach brings much benefit there. A complex search strategy only makes sense if the search is slow and compute intensive.
8.
by aszen 4mo ago
Coding agents prefer to do iterative search, I have yet to see them create a complex search script. They try different search cmds in parallel, evaluate their results and then refine or dive deeper. This approach usually works great but I c
9.
by aszen 4mo ago
By slowing down engineers with ai agents adding multiple code reviews on top. Also encouraging engineers to engage in manual testing themselves to better understand the product.
10.
by aszen 5mo ago
Claude code is not infra, the model is the infra. They changed settings to make their models faster and probably cheaper to run too. Honestly with adaptive thinking it no longer matters what model it is if you can dynamically make it do les
11.
by aszen 5mo ago
Same here. Reviewing gets harder too and multi tasking kills any kind of productivity if you need to review the code then. My approach these days is to do one change at a time, until I can fully merge it with confidence.
12.
by aszen 5mo ago
This is quite interesting, will try it. I kind of expect this to be done continuously as the code base changes.
13.
by aszen 6mo ago
This article doesn't mention the moat of data gathering, frontier AI labs have a huge advantage in curating proprietary datasets from actual usage of their platforms. This in turn allows them to optimize their models for the long tail
14.
by aszen 6mo ago
Seems like you are testing llms genric abilities rather than your actual agent logic. Llms are like vendor code you don't need to test them yourself people already created benchmarks for that.
15.
by aszen 7mo ago
If you buy real handcrafted scarves they are both thinner and warmer than anything factory made bcz of their choice of pashmina wool.
16.
by aszen 7mo ago
So the new implementation always operates at the line level, replacing one or more lines. That's not ideal for some refactorings like rename where search and replace is faster. Edit Checking ohmypi The model has access to str replace t
17.
by aszen 8mo ago
I bet writing the code directly could have been even faster, llms aren't magically fast
18.
by aszen 8mo ago
https://devenv.sh/integrations/secretspec/
19.
by aszen 8mo ago
I wonder why we are even storing secrets in .env files in plain text
20.
by aszen 8mo ago
How? You don't know what the llm was trained on and don't know if it has any bias. Imo llms are a disaster for knowledge work because they act like a black box.
21.
by aszen 8mo ago
Stupid question but why not use a local sandbox for yolo mode instead of a remote machine. Is there a similar service that runs locally?
22.
by aszen 8mo ago
Agreed it probably contributes to the model improving for all agents but crucially it is verifiably better against their own agent. So they get a good feedback loop to improve both
23.
by aszen 8mo ago
They nailed down the UX I would say and the models themselves are a lot better even outside of CC
24.
by aszen 8mo ago
Yeah that's one example, but I suspect they train the model on entire sequences of tool calls, so unless you prompt the model exactly as them you won't get the same results. There's a reason they won the agent race, their mod
25.
by aszen 8mo ago
Seems odd to not mention other semantic standards that standardize resource operations like pagination, sorting etc. Jsonld, json:api
26.
by aszen 8mo ago
The most imp part is editing code, to do that reliably Claude models are trained on their own str replace tool schema I think. Models find it hard to modify existing code, they also can't just rewrite whole files bcz that's expens
27.
by aszen 8mo ago
Can you elaborate on this?
28.
by aszen 8mo ago
I don't think so, model improvements far outweigh any harness or tooling. Look at https://github.com/SWE-agent/mini-swe-agent for proof
29.
by aszen 9mo ago
A custom ERP solution won't work because of audits, you need standard solutions at large scale. That's why even Google uses oracles ERP
30.
by aszen 9mo ago
How about you try vibe coding a banking app or tax filing or pay roll app? Most commercial software is nowadays integrated into the real world in ways that can't be replicated by code alone, software which isn't like this can be e

More ›