jl

7 ms·

1.
by __jl__ 12d ago
This is really a great achievement: "Astra dominates the output token frontier" Many labs used increased thinking to boost benchmark scores and performance. Most of the Chinese models were doing that for a while. Google and Anthro
2.
by __jl__ 2mo ago
Didn't expect that. Luna pricing is crazy now. I don't think there is anything on the market that competes at this price-performance point. For our production app, OpenAI clearly is the best provider now. Their API is very reliabl
3.
by __jl__ 4mo ago
This understates the cost increase. 3.5 Flash also uses more tokens. artificialanalysis.ai shows these difference to run the whole eval, which I think is more realistic pricing: Gemini 2.5 flash (27 score): $172 (1.0x) Gemini 2.5 pro (35 sc
4.
by __jl__ 4mo ago
In our experience, caching is not very reliable with google. We always get random cache misses that don't happen with other providers. We find OpenAI, Anthropic and Fireworks (which we use a lot) all have higher cache hit rates. So it&
5.
by __jl__ 7mo ago
I see your point. I do find Anthropic's approach more clean though particularly when you add in mini and nano. That makes 5 models priced differently. Some share the same core name, others don't: gpt 5 nano, gpt 5 mini, gpt 5.1, g
6.
by __jl__ 7mo ago
What a model mess! OpenAI now has three price points: GPT 5.1, GPT 5.2 and now GPT 5.4. There version numbers jump across different model lines with codex at 5.3, what they now call instant also at 5.3. Anthropic are really the only ones wh
7.
by __jl__ 7mo ago
Another preview release. Does that mean the recommended model by Google for production is 2.5 Flash and Pro? Not talking about what people are actually doing but the google recommendation. Kind of crazy if that is the case
8.
by __jl__ 7mo ago
Impressive jump for GPT-5.3-codex and crazy to see two top coding models come out on the same day...
9.
by __jl__ 8mo ago
Yes you can and I really like it as a feature. But it ties you to OpenAI…
10.
by __jl__ 9mo ago
I will have to try that. Cursor bill got pretty high with Opus 4.5. Never considered opus before the 4.5 price drop but now it's hard to change... :)
11.
by __jl__ 9mo ago
Mostly at the time of release except for 1.5 Flash which got a price drop in Aug 2024. Google has been discontinuing older models after several months of transition period so I would expect the same for the 2.5 models. But that process only
12.
by __jl__ 9mo ago
This is awesome. No preview release either, which is great to production. They are pushing the prices higher with each release though: API pricing is up to $0.5/M for input and $3/M for output For comparison: Gemini 3.0 Flash: $0.
13.
by __jl__ 10mo ago
API pricing is up to $2/M for input and $12/M for output For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output Gemini 1.5 Pro was $1.25/M for input and $5/M for output
14.
by __jl__ 10mo ago
API pricing is up to $2/M for input and $12/M for output For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output Gemini 1.5 Pro was $1.25/M for input and $5/M for output
15.
by __jl__ 10mo ago
Same here. They have been aggressively increasing prices with each iteration (maybe because they started so low). Still hope that is not the case this time. GPT 5.1 is priced pretty aggressively so maybe that is an incentive to keep the cur
16.
by __jl__ 10mo ago
The prompt caching change is awesome for any agent. Claude is far behind with increased costs for caching and manual caching checkpoints. Certainly depends on your application but prompt caching is also ignored in a lot of cost comparisons.
17.
by __jl__ 1y ago
Since we have cursor people joining, let me bring up my constant problems around applying code changes. For background, I mostly work with "chat": 1. The apply button does not appear. This used to be mostly a problem with Gemini 2
18.
by __jl__ 1y ago
1.5 -> 2.0 was a price increase as well (double, I think, and something like 4x for image input) Now 2.0 -> 2.5 is another hefty price increase.
19.
by __jl__ 1y ago
Same! :)
20.
by __jl__ 1y ago
Voyage models are great in my experience and I am planing to test 3.5. Almost more interested in 3.5-lite though. Great price. My concern: voyage api has been unreliable. They were bought by mango db, which makes me a little uneasy. Gemini
21.
by __jl__ 1y ago
Thanks. I looked a couple minutes ago and couldn't see it. For anyone curious, pricing remains the same as previous Anthropic models.
22.
by __jl__ 1y ago
Anyone found information on API pricing?
23.
by __jl__ 1y ago
Here are my two cents on cursors versus windsurf approach: CURSOR shifted to a more agentic approach even for chat requests to reduce input tokens. Previously, they used the good old RAG pattern with code dumps: Request with user added file
24.
by __jl__ 1y ago
Only problem is that the genai API at https://ai.google.dev is far less reliable and can be problematic for production use cases. Right around the time Gemini 2.0 launched, it was done for days on end without any communication.
25.
by __jl__ 1y ago
I think the 9 billion is very misleading. More than half goes to hospitals affiliated with Harvard. I am not sure but I don't think they get anything from the endowment. The impact of loosing this money would be very uneven across diff
26.
by __jl__ 2y ago
How does this compare with pg_search (formally pg_bm25) from ParadeDB?
27.
by __jl__ 2y ago
They commit to supporting the API in step 1 but it's not entirely clear to me whether that commitment continues with step 2-3...
28.
by __jl__ 2y ago
The numbers in the blog post seem VERY inaccurate. Quick calculation: Input pricing: Image input in 2.0 Flash is $0.0001935. Let's ignore the prompt. Output pricing: Let's assume 500 token per page, which is $0.0003 Cost per page:
29.
by __jl__ 2y ago
How do we know that they didn't see it? Their work is much more secret now. Isn't it possible that o1 and o3 rely on something similar maybe with some additions. Same for the gemini thinking models. My point it that OpenAI and goo
30.
by __jl__ 2y ago
Has anyone compared the updated Copilot with Cursor? The main updates I am wondering about are model selection and multi-file edits. I used copilot before these features, changed to Cursor and now I am wondering how much Copilot has closed

More ›

__jl__

jl