9 ms·
The Claude Code Framework Wars
- matt3D 1y agoPretty surprised BMAD-method wasn't mentioned. For my money it's by far the best Claude Code compliment.
- MarcelOlsz 1y agoSame with taskmaster, also not there.
- 3uler 1y agoI never found taskmaster that useful, something about how it forced you to work didn’t click with me…
- MarcelOlsz 1y agoYeah that's fair, it doesn't feel great. It does work if you have something very concrete you want to make and know how to do it, so its pretty easy to scope out into some tasks and subtasks, but working on something where you generate it as you go and requires editing tasks its pretty bad.
- CGamesPlay 1y agoWhat is this? Just a system prompt? What makes it so good for you? https://github.com/bmad-code-org/BMAD-METHOD https://github.com/bmad-code-org/BMAD-METHOD
- 3uler 1y agoIt’s basically a set of commands and agents and a way to structure context.
- touristtam 1y agoIt is Agile for interactive session with an LLM.
- matt3D 1y agoIt manifests as a sort of extension for Claude Code. When I'm in the terminal I can call on Agents who can create standardised documents so there is a memory of the product management side of things that extends beyond the context window of Claude. It guides you through the specification process so that you have extremely tight tasks for Claude to churn through, with any context, documentation and acceptance criteria. Perhaps there are others similar, but I have found it completely transformative.
- imiric 1y agoThis amuses me to no end: https://github.com/bmad-code-org/BMAD-METHOD/issues/546 https://github.com/bmad-code-org/BMAD-METHOD/issues/546 An AI tool finding issues in a set of YAML and Markdown files generated by an AI tool, and humans puzzled by all of it. > We should really have some code reviewer... Gemini to the rescue!
- 3uler 1y agoThe BMAD system seems similar to the AgentOS mentioned in the post. This way of context engineering has definitely been the way to go for me, although I’ve just implemented it myself… using Claude to help generate commands and agents and tweaking them to my liking, lately been using json as well as markdown to share context between steps.
- touristtam 1y agoBMAD is mentioned in the QA part, FWIW.
- troupo 1y ago> a set of rules, roles, and workflows that make its output predictable and valuable. Let me stop you right there. Are you seriously talking about predictable when talking about a non-deterministic black box over which you have no control?
- andsoitis 1y ago> Are you seriously talking about predictable when talking about a non-deterministic Predictability and determinism are related but different concepts. A system can be predictable in a probabilistic sense, rather than an exact, deterministic one. This means that while you may not be able to predict the precise outcome of a single event, you can accurately forecast the overall behavior of the system and the likelihood of different outcomes. https://philosophy.stackexchange.com/questions/96145/determinism-vs-prediction https://philosophy.stackexchange.com/questions/96145/determi... Similarly, a system can be deterministic yet unpredictable due to practical limitations like sensitivity to initial conditions (chaos theory), lack of information, or the inability to compute predictions in time.
- sublinear 1y agoThe topic of chaos is underrated when people talk about deterministic systems, but I think it's at least (usually?/always?) a tractable problem to draw up a fractal or something and find the non-chaotic regions of a solution space. You have nice variables to work with when you draw up a model of the problem. Maybe someone can elaborate better, but it seems there is no such luck trying to map probability onto problems the way "AI" is being used today. It's not just a matter of feeding it more data, but finding what data you haven't fed it or in some cases knowing you can't feed it some data because we have no known way to represent what is obvious to humans.
- troupo 1y agoFrom the discussion in the link: "Predictability means that you can figure out what will happen next based on what happened previously." Having used nearly all of the methods in the original article, I can predict that the output of the model is nearly indistinguishable from a coin toss for many, many, many rather obvious reasons.
- AbuAssar 1y agodid anyone try any of these so called frameworks? do they deliver or just riding the hype-wagon?
- stuartjohnson12 1y agoHaving occasionally looked into these, the overwhelming issue is that pretty much all of them are built with themselves and the output is what you'd expect - vast quantities of untested functionality, no documentation beyond a wall of Claude-isms about how next generation and feature rich it is, and no thought to applicability beyond the narrow set of projects that interest the author.
- CompoundEyes 1y agoFor anyone that’s applied one of these at what level of autonomy are you using it? And in what setting? Greenfield? I see one mention brownfield development. Has anyone with experience using these frameworks fired up Claude Code on enterprise software and had confident results? I have unchecked access to Claude Code at work and based on personal agentic coding I’m sure they do aid it. I have decent but not consistent results with my own “system” in our code base. At least until the front end UI components are involved even with Playwright. But I’m curious — how much litter is left behind? How is your coworker tolerance? How large are your pull requests? What is your inference cost? How do these manage parallel? The README documentation for many have a mix of fevered infomercial, system specific jargon, emoji splatter and someone’s dad’s very specific toolbox organization approach only he understands. Some feel like they’re setting the stage to sell something…trademarked!? Won’t Anthropic and others just incorporate the best of the bunch into their CLI tools in time? Outside of work I’ve regularly used a reasoning model to produce a ten page spec, wired my project with strictest lint, type check, formatter, hooks, instruct it to check off as it goes and do red green TDD. I can tell gpt-5 in Cursor to “go”, occasionally nudge to stay on task and “ok next” then I’ll end up with what I wanted in time plus gold plating. The last one was a CLI tool for my agent to invoke and track their own work. Anyone with the same tools can just roll their own.
- dsiegel2275 1y agoI'm only three weeks into using Claude Code but I'm now seeing impressive results using a structured, "role" or "persona" based approach in a large (500K+ SLOC) Elixir / Phoenix codebase. I'm using the $200 Max plan - so my inference costs are fixed. For certain, the results are better when I use it to build new features into our platform - as opposed to making complicated refactors or other deep changes to existing parts of the system. But even in the latter case, if we have good technical documentation capturing the design and how parts of the system work (which we don't in many places), Claude Code can make good progress. At first I was seeing a fair amount of what I would consider "bad code" - implementation and code that either didn't follow accepted coding style and patterns or that simply wasn't structured for reusability, maintainability. But after strengthening the CLAUDE.md file and adding an "elixir-code-reviewer" subagent which the "developer" persona had to use - the quality of code improved significantly. Our platform is open source, you can see our current Claude commands and subagents here: https://github.com/Simon-Initiative/oli-torus/tree/master/.claude https://github.com/Simon-Initiative/oli-torus/tree/master/.c...
- musbemus 1y agoOne thing I hope to see included is a precursor step when constructing specs where Claude is used to intelligently inquire about gaps to fill that would disambiguate the implementation. If you told an engineer to do something with a set of requirements and outcomes, they'd naturally also have follow-up questions to ensure alignment before executing.
- joshstrange 1y agoYes, kind of like open AI’s deep research tool. I often find that a number of mistakes are made because no clarification questions or ask or even considered.
- stocksinsmocks 1y agoI got a strong sense of LLM style in the blog. Interesting information, but that I’m learning about AI from AI is amusing.
- stingraycharles 1y agoYeah, unfortunately this is very often the case with articles about AI. In my own experience, this type of stuff is just wishful thinking right now: for anything non-trivial, you still need to monitor Claude Code closely and interrupt when you discover it goes on the wrong train of thought. Additionally, for security reasons, you don’t want it to give it too many permissions, and/or actually see which commands it’s executing. The “frameworks” OP talks about are still far away. Right now the best way to think about it is an intern which is usually wrong but can cramp out code at lightning speed.
- Szpadel 1y agolooks like either author didn't checked well repos that link or it's indeed redacted deep research output. Examples: superClaude is not mcp server at all metaGPT looks like is not compatable with Claude code at all
- d_503 1y agoClown wars
- grim_io 1y agoI've tried some of those "frameworks" for claude code, but it's difficult to measure any objective improvement. I tend to lean towards them being snake oil. A lot of process and ritual around using them, but for what? I don't think the models themselves are a good fit for the way these frameworks are being used. It probably goes against their training. Now we try to poison the context with lots of (for my actual task at hand) useless information so that the model can conform to my superficial song-and-dance process? This seems backwards. I would argue that we need less context poisoning with useless information. Give the model the most precise information for the actual work to be done and iterate upon that. The song and dance process should happen outside of the context constrained agent.
- montroser 1y agoIt's kinda the same as real life project managers.
- bicx 1y agoI adopted a couple practices (using dev containers and worktrees) just to make life a little easier. I also built my own shell script “framework” to help manage the worktrees and create project files. However, that took me just a couple days to do on my own (also using CC), and it didn’t lock me into a specific tool. I do agree that context poisoning is a real thing to watch out for. Coincidentally, I’d noticed MCP endpoint definitions had started taking a substantial block of context for me (~20k tokens), and that’s now something I consider when adopting any MCP.
- grim_io 1y agoI'm considering removing serena MCP, since cc got better with its own tools. The new /context cc command is great for visualizing what uses how much of the context. On the other hand, I'm curious about dagger's container-use MCP. https://container-use.com/agent-integrations https://container-use.com/agent-integrations
- nicwolff 1y agoThis article doesn't mention "subagents" https://docs.anthropic.com/en/docs/claude-code/sub-agents https://docs.anthropic.com/en/docs/claude-code/sub-agents which makes me wonder when it was written. I'm finding that just delegating "scan the memory bank for information relevant to the current task" and "run the unit and functional tests and report back only the failures or coverage" to subagents does a lot to keep the main agent's context from filling up.
- g42gregory 1y agoI tried B-MAD Framework and it was like night and day. Can’t work without it. I’d like to see more frameworks like that.
- anonyfox 1y agoisn't this textbook "bitter lesson" playing out here again? whatever "frameworks" people try to build, the next generation of models will make them obsolete, no? --- link: http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- touristtam 1y agoThe models are still ingesting text, are they not? Those framework are providing textual guidance to what the task at hand should be aim for. Those are formalising part of the context passed to the LLM, regardless of the model itself.
- sharts 1y agocontext management seems like low level programming where you need to carefully place the right things on cpu registers to do the operation you want correctly. On difference is that we have less control of the context to add/remove things per task necessary.
- faangguyindia 1y agoI often wonder why agent is not allowed to manage its own context like humans do? Why recycle full history into every future turn until you run out of context window? Perhaps letting agent manage its own context while knowing what an effective context and the harm or going over context or smartly making that tradeoff, it can navigate the tasks better?
- vivzkestrel 1y agowhat is your opinion about the research paper that got published recently which claims that AI coding actually slows you down 20%
- 3uler 1y agoThat’s like saying a vim expert would be slower in VS Code - technically the IDE does more, but expertise with your existing tools often beats learning new ones. Also that study was from early 2025 before Claude 4 which to me was a big break through in productivity, I did not really find these tools too useful before using sonnet 4.
- vivzkestrel 1y agobut has that cut down your prompting time, i assume an AI agent would take a fixed amount of time to generate N lines of code. Constructing effective prompts is probably where most time is spent, has this time been cut down with newer releases or has it been proved somehow that we need N less prompts to achieve the same result with newer AI models?
- 3uler 1y agoIt’s less about the models getting smarter and more about them getting better at handling vague requests and context acquisition. They’re better at figuring out what they need to know, I’m better at shaping that process, and I have structured workflows for managing and efficiently feeding the right context into each prompt.