7 ms·
GPT-6 Astra in code review: Gains, privacy, and cost
- ramon156 12d agoBoth OAI and Anthropic seem to have released a model that is slightly better but cost ~2x the previous iteration. Interesting play
- simianwords 12d agoInteresting comment because it is true that Astra is costlier for the same intelligence tasks as Sol. But this is not the same for Fable at all.
- kzrdude 12d agoThat should be expected based on the scaling laws that we expect; larger models are more intelligent and cost more. Now it's very unfortunately that they don't publish the size of their models.
- arthurcolle 12d agoAstra and Sol are the same price when you factor in token efficiency
- Squarex 12d agoI don't know, in the Codex app, it burns the limit much faster.
- sscaryterry 12d agoBullshit.
- arthurcolle 11d agoNot bullshit
- sscaryterry 11d agoMost certainly is.
- jstummbillig 12d agoRoughly how we price (high skilled) human labor.
- villish 12d agoThat likely won’t change if other competitors don’t take the lead at some point. If companies are willing to pay top dollar for the best models AND they get to extract as much money from Chinese labs distilling Astra/Fable it makes no sense to lower prices. Obviously not great for everyday users who don’t have unlimited money.
- skrellm 11d ago> If companies are willing to pay top dollar for the best models But they are not willing to pay. https://news.ycombinator.com/item?id=49566137 https://news.ycombinator.com/item?id=49566137 The referenced NYT article says Open Source LLM's market share increased to 58% from yesteryear's 10%.
- villish 11d ago(58% on OpenRouter) I believe both things can be true. OAI/Anthropic selling more tokens than ever, and downloadable weight models increasing in market share. I doubt OpenAI would copy Fables pricing if it wasn’t financially beneficial. They can only burn through VC funding for so long.
- dgellow 11d agoI don’t think we have data showing that fable is used significantly
- torginus 11d agoGenerally speaking 'the Fable/Astra built GTA 6' videos are a new phenomenon, so it's clear these models have new capabilities and people will need new ways of interacting with them if they want to leverage these imo.
- GUSTAVOSIS 12d ago[flagged]
- jens_tlb 12d ago[dead]
- eyalitki 12d agoComparison was done in the scope of coderabbit AI code review tool, which sadly makes it practically irrelevant. My personal experience as a software engineer, and a former security researcher who did manual code audit, is that this code review tool has such poor results that it isn't worth the "noise" and friction it causes developers during C/I code review
- stingraycharles 12d agoYeah I personally don’t understand the point of AI code review tools all that much, as AI is already generating the code as well. All of these AI code review tools create so much noise, yet don’t catch the really important things.
- jiggawatts 12d agoCode review tools are designed for less organised dev teams that don’t do PRs and mandatory human reviews already. It is papering over a lower level of competency without having to invest in actual human oversight or real process improvement.
- 9dev 12d agoThat's a thoroughly uncharitable view. Especially in smaller orgs with a minimum velocity dictated by the company's need to survive, the amount of code required to be written just to keep up with your competitors is massive. Trying to review that all by hand, thoroughly, is draining, thankless, and tedious. You end up with a few fast movers producing most of the code, and some slower movers forced into a reviewer role they never signed up for. It's an unhealthy dynamic.
- pinkgolem 12d agoWhat really important things are human reviews catching in your org? I just feel more and more like the effort invested in manual reviews is not worth it
- 12d ago
- SneakyZero 12d agoAstra seems to be really slow. Maybe it intends to read more context. But from my experience it is definitely slower than 5.6 sol when handling same tasks.
- trvz 12d agoIt's a bigger model, of course it's slower.
- tosh 11d agofwiw I found Astra to be faster than Sol w/ both on medium reasoning for simple agentic coding difficult to compare though because for more open ended, complex tasks Sol might miss something that Astra notices and then Sol might yield a cheaper but worse outcome
- sscaryterry 12d agoFrom what I can tell, its shit.
- dude250711 12d agoGiven that Fable is a Sol-class model, should Astra not be compared to Mythos in those tests?
- KAdot 11d agoI heavily A/B tested Opus vs Sol for two weeks, giving Claude Code and Codex the same tasks and comparing the results. In my experience Sol is much closer to Opus than to Fable, with Opus often beating Sol. The only area where Sol is better is code reviews, which these benchmarks confirm. I wish they included Fable.
- sdeframond 11d agoHow do you guys review AI-generated code ? In our team, frontend work is vibe-coded by the PO and merged as-is without review. Backend is coded by developers, using AI but in a slower, more controlled way. Recently, our PO has been trying his hand at vibe-coding the backend. I must say he is a smart guy, almost technical but not quite a developer. We've just been handed a burst of stacked PRs amounting for ~15k LOC backend. We do not quite know what do to about it. I know we are not the only ones in the situation. What's your experience and context ? What do you do ? What works for you what doesn't ?
- oscarestudillom 7d agowe are using Revix AI, works really good on repos that already have some standards and patterns from good devs. the reviewer catches most of the things so when the senior reviews he just have to focus on more elevated things like architecture, etc. moreover, try to enforce having AGENTS.md files on your repos, and rules created by the senior devs specific to your repo, its not perfect but also helps quite a lot
- mobelkh 11d agothrow his garbage out, the time and effort taken to review that is magnitudes more than what it took to prompt it. have him start with an overall design doc if his change is 15k, it's definitely worth a design doc. and then have his contributions reviewed in pieces of 200-300 LoC PRs. any other solution is trading stability and system knowledge, that's 15k LoC no one is truly familiar with, even if you do try to review it
- embedding-shape 11d agoYeah, it's the "eager apprentice" problem, common almost everywhere. Solution is to make them stop and double-check before running ahead, in software development, concise design documents outlining what the problem is, what possible solutions are and what the chosen solution is, and why, then review this together with the person, before they can move on to implement it.
- 11d ago
- tosh 11d agoI ran a few toy benches comparing Astra with Sol and found Astra ~30% faster and at similar cost to Sol for the same outcome https://x.com/__tosh/status/2096201900555170032 https://x.com/__tosh/status/2096201900555170032 the token efficiency helps Astra even though sticker price is 2.5x that of Sol
- vb-8448 11d agoSame experience here, but I have some strange feeling. Sol I'm used to working a month ago doesn't feel the same I'm using today, slower and less accurate. My gut feeling is that they quantize previous models to prioritize new ones and, who nows, make the new one look better. Up to July I was using mostly anthropic models and the feeling was the same, so much so that I was able to predict every model release 1 or 2 days before public announcements.
- sscaryterry 11d agoLooks like a shameless OpenAI plug
- jacobbe 10d ago[flagged]
- GUSTAVOSIS 9d agoi really like it
- JavaCoder7 8d ago[flagged]