23 ms·
ARC-AGI has a hidden private test suite, right ? No model will have access to that set.
by knowriju 10mo ago
ARC-AGI has a hidden private test suite, right ? No model will have access to that set.
- variadix 10mo agoI doubt they have offline access to the model, i.e. the prompts are sent to the model provider.
- xlbuttplug2 10mo agoEven if the prompts are technically leaked to the provider, how would they be identified as something worth optimizing for out of the millions of other prompts received?