peterbell_nyc

8 ms·

1.
by peterbell_nyc 2mo ago
Wait, did you let the same agent write the tests that wrote the implementation? Or was it that the plan was the wrong way round, and both the generator of code and the generator of the tests followed that same incorrect plan? Also, what wer
2.
by peterbell_nyc 2mo ago
Wow - so one really good researchers salary/stock grant. I feel like they're underinvesting...
3.
by peterbell_nyc 2mo ago
Yeah, this has been my biggest contention with the models everywhere paradigm. I will definitely use a supervisor pattern and advisor pattern for simpler models when I just want to throw something together interactively with Fable and a few
4.
by peterbell_nyc 2mo ago
LOL - too competent for their own good :(
5.
by peterbell_nyc 2mo ago
Also have a workspace as a personal email and ended up getting a personal gmail just to try out the subscriptions before I gave up. I have multiple anthropic and OpenAI max plans. For Gemini I just use my Cursor $200 a month plan (which als
6.
by peterbell_nyc 2mo ago
I would take the other side of this bet. While I agree that the impact of any given advance is likely to resemble a sigmoid curve, I think there is a material chance of "stacking sigmoids" creating something that looks exponential
7.
by peterbell_nyc 3mo ago
So many thoughts AI can materially improve PRs - you just have to do it right. Firstly there are not going to be a material number of non-AI patches written in the future. I know some people still ride horses, but when compared to the 17th
8.
by peterbell_nyc 3mo ago
The problem isn't the AI - it's the assessments. It used to be that shipping a large, well-researched essay with multiple citations was proof of work. Now it's proof of prompting, not learning or effort. If you want to test f
9.
by peterbell_nyc 3mo ago
I auto tune my prompts to a locked model version based on production data used as evals with holdback data. I think the use case for this would be one off interactive prompts? For now I just run those all against an Opus 4.8 MAX and I'
10.
by peterbell_nyc 3mo ago
Honestly my goal is to learn how to teach an agent to build a maintainable product, so I'm way more interested in the learnings at the agentic level (how to prompt/direct/manage context/restrict tool use, provide reusabl
11.
by peterbell_nyc 3mo ago
The agent isn't the hard part - it's the orchestration, skills, research systems, adversarial reviews, dreaming/compounding, context management and all the rest. Plus all the annoying hygiene tools to "poke the agent tha
12.
by peterbell_nyc 3mo ago
This this this! Anyone have something they genuinely like for all of this? For now I'm rolling my own, but I can't believe I won't find a better OSS alternative soon...
13.
by peterbell_nyc 3mo ago
Pi is a nice multi-agent wrapper. I use it to wrap my OpenAI max plan calls and my API calls. It takes care of some of the agent plumbing - still need sandbox, orchestrator, compounding, context, evals, etc but it's a nice component.
14.
by peterbell_nyc 3mo ago
For me the heart of an agentic system is NOT using agents (except when you really have to). Components of a working system include: - Pipelines/recipes to describe multi-step flows (deterministic, agentic and HiTL steps), loops, condit
15.
by peterbell_nyc 3mo ago
Thank you. While I do not agree with him on every point (across his corpus - this one was excellent for it's time), it's a delight to re-read a Paul Graham essay. There are a few topical short-form non-fiction writers that feel tr
16.
by peterbell_nyc 4mo ago
There's a huge difference between one shot and few shot versus building a robust harness with deterministic and adversarial quality gates. And I'm finding that agents can actually do a pretty good job of a surprising number of thi
17.
by peterbell_nyc 4mo ago
Anyone using this headlessly got a read on how much of this an agent could do without human intervention? Would love to have a gut check on "sure, spend the $295 and you'll get some benefits for free if you have an agent run your
18.
by peterbell_nyc 4mo ago
Re: the higher ranking plagarism, that stings and makes sense. AEO and SEO are a thing. We need better mechanisms for identifying "root sources" of content - it's something I find myself working on personally. As I ingest sou
19.
by peterbell_nyc 4mo ago
I do just want to highlight that this is also what humans do. We read a bunch of content online and then use it in our work product. The vast majority of the value that I provide comes from copyrighted information that I have ingested - eit
20.
by peterbell_nyc 4mo ago
Love the DDD callout. I have explicit steps to review and rate delta's to the ubiquitous language and one of my architectural reviewers will often engage with me about where the bounded contexts should be and will probably the translat
21.
by peterbell_nyc 4mo ago
I'm generally in agreement with everyone here. - Some code is ephemeral - it's generated to do the thing, thrown away end of session and the csv was imported successfully (or whatever). Make sure you have at least some testing of
22.
by peterbell_nyc 4mo ago
For me the distinction is the quality and rigor of your pipeline. Vibe coding: one shot or few shot, smoke test the output, use it until it breaks (or doesn't). Ideal for lightweight PoC and low stakes individual, family or small team
23.
by peterbell_nyc 4mo ago
Helps if you both hand to original agent as strong guidance and then to an adversarial agent as a quality reviewer. The adversarial agent is more likely tro loop the work back if it fails the validation criteria. I do find that just asking
24.
by peterbell_nyc 5mo ago
Why crack one website when you can crack all of them? For a well funded (especially nation state) attacker, if $1 in compute and effort returns $2 in ransoms, when it's possible to access another n x $1 of compute and if you don't
25.
by peterbell_nyc 5mo ago
Exactly this. I'm writing my own little orchestrator and memory system and because I have a modest number of workflows, I'm taking the time to specify them deterministically, describe them as a DAG (with goto's for the inevit
26.
by peterbell_nyc 5mo ago
Seeing plenty of this. The quality of agentic code is a function of the quantity and quality of adversarial quality gates. I have seen no proof that an agentic system is incapable of delivering code that is as functional, performant and mai
27.
by peterbell_nyc 5mo ago
I model this as "stacked sigmoid curves". I have no reason to believe that any specific technological implementation will be exponential in impact vs sigmoidal. However if we throw enough money and smart people at the problems and
28.
by peterbell_nyc 6mo ago
4.5 and 5.2. Transformative. I know dozens of CTOs who were piloting AI in the fall, took a day to do something real over Xmas and then came back to their orgs with a mandate to double down and experiment with software factories once they s
29.
by peterbell_nyc 2y ago
There's a reason there are IC and manager tracks at most companies employing devs. You can keep refining your craft as an IC and become a Staff/Principal/Distinguished. No need to become a manager to get promotions, more mone
30.
by peterbell_nyc 2y ago
You just made my day - whatever the answer :)

More ›