6 ms·

In particular, the API pricing for GPT-5.2 Pro has me wondering what on earth the possible market for that model is beyond getting to claim a couple of percent

In particular, the API pricing for GPT-5.2 Pro has me wondering what on earth the possible market for that model is beyond getting to claim a couple of percent higher benchmark performance in press releases. >Input: >$21.00 / 1M tokens >Output: >$168.00 / 1M tokens That's the most "don't use this" pricing I've seen on a model. https://openai.com/api/pricing/ https://openai.com/api/pricing/

reactordev 9mo ago
Less an issue if your company is paying
- rvnx 9mo ago
  Even less an issue when OpenAI provides you free credits
arthurcolle 9mo ago
gpt-4-32k pricing was originally $60.00 / $120.00.
Leynos 9mo ago
Someone on Reddit reported that they were charged $17 for one prompt on 5-pro. Which suggests around 125000 reasoning tokens. Makes me feel guilty for spamming pro with any random question I have multiple times a day.
asgraham 9mo ago
Those prices seem geared toward people who are completely price insensitive, who just want "the best" at any cost. If the margins on that premium model are as high as they should be, it's a smart business move to give them what they want.
wahnfrieden 9mo ago
Pro solves many problems for me on first try that the other 5.1 models are unable to after many iterations. I don't pay API pricing but if I could afford it I would in some cases for the much higher context window it affords when a problem calls for it. I'd rather spend some tens of dollars to solve a problem than grind at it for hours.
aimanbenbaha 9mo ago
Last year o3 high did 88% on ARC-AGI 1 at more than $4,000/task. This model at its X high configuration scores 90.5% at just $11,64 per task. General intelligence has ridiculously gotten less expensive. I don't know if it's because of compute and energy abundance,or attention mechanisms improving in efficiency or both but we have to acknowledge the bigger picture and relative prices.
- commandar 9mo ago
  Sure, but the reason I'm confused by the pricing is that the pricing doesn't exist in a vacuum. Pro barely performs better than Thinking in OpenAI's published numbers, but comes at ~10x the price with an explicit disclaimer that it's slow on the order of minutes. If the published performance numbers are accurate, it seems like it'd be incredibly difficult to justify the premium. At least on the surface level, it looks like it exists mostly to juice benchmark claims.
  - rvnx 9mo ago
    It could be using the same early trick of Grok (at least in the earlier versions) that they boot 10 agents who work on the problem in parallel and then get a consensus on the answer. This would explain the price and the latency. Essentially a newbie trick that works really well but not efficient, but still looking like it's amazing breakthrough. (if someone knows the actual implementation I'm curious)
    - anticensor 9mo ago
      The magic number appears to be 12 in case of GPT 5.2 pro.

reactordev 9mo ago

Less an issue if your company is paying

rvnx 9mo ago
Even less an issue when OpenAI provides you free credits

arthurcolle 9mo ago

gpt-4-32k pricing was originally $60.00 / $120.00.

Leynos 9mo ago

Someone on Reddit reported that they were charged $17 for one prompt on 5-pro. Which suggests around 125000 reasoning tokens. Makes me feel guilty for spamming pro with any random question I have multiple times a day.

asgraham 9mo ago

Those prices seem geared toward people who are completely price insensitive, who just want "the best" at any cost. If the margins on that premium model are as high as they should be, it's a smart business move to give them what they want.

wahnfrieden 9mo ago

Pro solves many problems for me on first try that the other 5.1 models are unable to after many iterations. I don't pay API pricing but if I could afford it I would in some cases for the much higher context window it affords when a problem calls for it. I'd rather spend some tens of dollars to solve a problem than grind at it for hours.

aimanbenbaha 9mo ago

Last year o3 high did 88% on ARC-AGI 1 at more than $4,000/task. This model at its X high configuration scores 90.5% at just $11,64 per task. General intelligence has ridiculously gotten less expensive. I don't know if it's because of compute and energy abundance,or attention mechanisms improving in efficiency or both but we have to acknowledge the bigger picture and relative prices.

commandar 9mo ago
Sure, but the reason I'm confused by the pricing is that the pricing doesn't exist in a vacuum. Pro barely performs better than Thinking in OpenAI's published numbers, but comes at ~10x the price with an explicit disclaimer that it's slow on the order of minutes. If the published performance numbers are accurate, it seems like it'd be incredibly difficult to justify the premium. At least on the surface level, it looks like it exists mostly to juice benchmark claims.
- rvnx 9mo ago
  It could be using the same early trick of Grok (at least in the earlier versions) that they boot 10 agents who work on the problem in parallel and then get a consensus on the answer. This would explain the price and the latency. Essentially a newbie trick that works really well but not efficient, but still looking like it's amazing breakthrough. (if someone knows the actual implementation I'm curious)
  - anticensor 9mo ago
    The magic number appears to be 12 in case of GPT 5.2 pro.