4 ms·
About ARC 2: I would want to hear more detail about prompts, frameworks, thinking time, etc., but they don't matter too much. The main caveat would be that thi
by jmmcd 10mo ago
About ARC 2:
I would want to hear more detail about prompts, frameworks, thinking time, etc., but they don't matter too much. The main caveat would be that this is probably on the public test set, so could be in pretraining, and there could even be some ARC-focussed post-training - I think we don't know yet and might never know.
But for any reasonable setup, if no egregious cheating, that is an amazing score on ARC 2.
- jmmcd 10mo agoThis is on the semi-private set * https://x.com/arcprize/status/1990820655411909018 https://x.com/arcprize/status/1990820655411909018 * https://arcprize.org/guide https://arcprize.org/guide