6 ms·

Do I understand it correctly that OpenAI self-proclaimed that they got their gold, without the official IMO judges grading their solutions?

ipsum2 1y ago
Yes
jacquesm 1y ago
Why am I not surprised?
danjl 1y ago
Childish. And, of course they must have known there was an official LLM cohort taking the real test, and they probably even knew that Gemini got a gold medal, and may have even known that Google planned a press release for today.
- cma 1y ago
  I think maybe all Altman companies have used tactics like this. > We were trying to get a big client for weeks, and they said no and went with a competitor. The competitor already had a terms sheet from the company were we trying to sign up. It was real serious. > We were devastated, but we decided to fly down and sit in their lobby until they would meet with us. So they finally let us talk to them after most of the day. > We then had a few more meetings, and the company wanted to come visit our offices so they could make sure we were a 'real' company. At that time, we were only 5 guys. So we hired a bunch of our college friends to 'work' for us for the day so we could look larger than we actually were. It worked, and we got the contract. > I think the reason why PG respects Sam so much is he is charismatic, resourceful, and just overall seems like a genuine person. https://news.ycombinator.com/item?id=3048944 https://news.ycombinator.com/item?id=3048944
  - pishpash 1y ago
    So, a more charismatic version of Zuck is Zucking, what a surprise. Company culture starts at its origin. Despite Google's corruption, its origin is in academia and it shows even now.
  - gowld 1y ago
    For a long time, the YC application asked founders for an example of how they "hacked" (cheated) a system.
    - tough 1y ago
      I think pg was into it way before sama was a baby lol https://www.paulgraham.com/gh.html https://www.paulgraham.com/gh.html
  - tough 1y ago
    >> > I think the reason why PG respects Sam so much is he is charismatic, resourceful, and just overall seems like a genuine person. does he? wasn't sama ousted of YC in some muddy ways after he tried to co-opt in into an OpenAI investment arm, was funny to find the YC Open Research project landing page on yc's website now defunct and pointing how he misrepresented it as a YC project when it was his own maybe he fears him, but I doubt pg respects him, unless he respects evil, lol
    - cma 1y ago
      The post was from 14 years ago, before that.
      - tough 1y ago
        oh, gotcha
gametorch 1y ago
(deleted because I was mistaken)
- nomad_horse 1y ago
  isn't he an IOI medalist? and even if he was an IMO medalist, isn't there a bit of a conflict of interests?
  - cbsmith 1y ago
    Just a wee bit.
- cbsmith 1y ago
  I'm pretty sure when they got the gold medal they weren't allowed to judge themselves.
NitpickLawyer 1y ago
Well, I don't doubt that they did get those results, but it is clear now that it was not an official collaboration. It was heavily implied in a statement by IMO's president a few days ago (the one where they said they'd prefer AI companies wait a week before announcing, so that the focus is first on the human competitors). Goog had an official colab with IMO, and we can be sure they got those results under the imposed constraints (last year they allocated ~48h for silver IIRC) and an official grading by the IMO graders.
- Tadpole9181 1y ago
  So from 48 hours for silver down to 4.5 hours for gold in one year? And all reasoning generated is clear and easy to follow? That's one hell of an improvement.
ddddang 1y ago
[dead]
tshadley 1y ago
Yes, OpenAI: https://x.com/alexwei_/status/1946477754372985146 https://x.com/alexwei_/status/1946477754372985146 > 6/N In our evaluation, the model solved 5 of the 6 problems on the 2025 IMO. For each problem, three former IMO medalists independently graded the model’s submitted proof, with scores finalized after unanimous consensus. The model earned 35/42 points in total, enough for gold! That means Google Deepmind is the first OFFICIAL IMO Gold. https://x.com/demishassabis/status/1947337620226240803 https://x.com/demishassabis/status/1947337620226240803 > We've now been given permission to share our results and are pleased to have been part of the inaugural cohort to have our model results officially graded and certified by IMO coordinators and experts, receiving the first official gold-level performance grading for an AI system!
- nomad_horse 1y ago
  Do you know if OpenAI used the same grading criteria as official judges?
  - tshadley 1y ago
    As IMO medalists they would be expected to I'm sure. But this can be verified because the results are public: https://github.com/aw31/openai-imo-2025-proofs/ https://github.com/aw31/openai-imo-2025-proofs/

ipsum2 1y ago

Yes

jacquesm 1y ago

Why am I not surprised?

danjl 1y ago

Childish. And, of course they must have known there was an official LLM cohort taking the real test, and they probably even knew that Gemini got a gold medal, and may have even known that Google planned a press release for today.

cma 1y ago
I think maybe all Altman companies have used tactics like this. > We were trying to get a big client for weeks, and they said no and went with a competitor. The competitor already had a terms sheet from the company were we trying to sign up. It was real serious. > We were devastated, but we decided to fly down and sit in their lobby until they would meet with us. So they finally let us talk to them after most of the day. > We then had a few more meetings, and the company wanted to come visit our offices so they could make sure we were a 'real' company. At that time, we were only 5 guys. So we hired a bunch of our college friends to 'work' for us for the day so we could look larger than we actually were. It worked, and we got the contract. > I think the reason why PG respects Sam so much is he is charismatic, resourceful, and just overall seems like a genuine person. https://news.ycombinator.com/item?id=3048944 https://news.ycombinator.com/item?id=3048944
- pishpash 1y ago
  So, a more charismatic version of Zuck is Zucking, what a surprise. Company culture starts at its origin. Despite Google's corruption, its origin is in academia and it shows even now.
- gowld 1y ago
  For a long time, the YC application asked founders for an example of how they "hacked" (cheated) a system.
  - tough 1y ago
    I think pg was into it way before sama was a baby lol https://www.paulgraham.com/gh.html https://www.paulgraham.com/gh.html
- tough 1y ago
  >> > I think the reason why PG respects Sam so much is he is charismatic, resourceful, and just overall seems like a genuine person. does he? wasn't sama ousted of YC in some muddy ways after he tried to co-opt in into an OpenAI investment arm, was funny to find the YC Open Research project landing page on yc's website now defunct and pointing how he misrepresented it as a YC project when it was his own maybe he fears him, but I doubt pg respects him, unless he respects evil, lol
  - cma 1y ago
    The post was from 14 years ago, before that.
    - tough 1y ago
      oh, gotcha

gametorch 1y ago

(deleted because I was mistaken)

nomad_horse 1y ago
isn't he an IOI medalist? and even if he was an IMO medalist, isn't there a bit of a conflict of interests?
- cbsmith 1y ago
  Just a wee bit.
cbsmith 1y ago
I'm pretty sure when they got the gold medal they weren't allowed to judge themselves.

NitpickLawyer 1y ago

Well, I don't doubt that they did get those results, but it is clear now that it was not an official collaboration. It was heavily implied in a statement by IMO's president a few days ago (the one where they said they'd prefer AI companies wait a week before announcing, so that the focus is first on the human competitors). Goog had an official colab with IMO, and we can be sure they got those results under the imposed constraints (last year they allocated ~48h for silver IIRC) and an official grading by the IMO graders.

Tadpole9181 1y ago
So from 48 hours for silver down to 4.5 hours for gold in one year? And all reasoning generated is clear and easy to follow? That's one hell of an improvement.

ddddang 1y ago

[dead]

tshadley 1y ago

Yes, OpenAI: https://x.com/alexwei_/status/1946477754372985146 https://x.com/alexwei_/status/1946477754372985146 > 6/N In our evaluation, the model solved 5 of the 6 problems on the 2025 IMO. For each problem, three former IMO medalists independently graded the model’s submitted proof, with scores finalized after unanimous consensus. The model earned 35/42 points in total, enough for gold! That means Google Deepmind is the first OFFICIAL IMO Gold. https://x.com/demishassabis/status/1947337620226240803 https://x.com/demishassabis/status/1947337620226240803 > We've now been given permission to share our results and are pleased to have been part of the inaugural cohort to have our model results officially graded and certified by IMO coordinators and experts, receiving the first official gold-level performance grading for an AI system!

nomad_horse 1y ago
Do you know if OpenAI used the same grading criteria as official judges?
- tshadley 1y ago
  As IMO medalists they would be expected to I'm sure. But this can be verified because the results are public: https://github.com/aw31/openai-imo-2025-proofs/ https://github.com/aw31/openai-imo-2025-proofs/