8 ms·
seeing a jump this big is not a great sign for the continuing value of a benchmark
by oh_no 2mo ago
seeing a jump this big is not a great sign for the continuing value of a benchmark
- modeless 2mo agoIt will continue to be valuable as a cost and speed benchmark long after it is saturated at the high end. And they are already working on ARC-AGI 4 and thinking about going even farther.