5 ms·
We don't actually know if it is SOTA, the previous SOTA solution also got around the same on the evaluation set.
by traject_ 2y ago
We don't actually know if it is SOTA, the previous SOTA solution also got around the same on the evaluation set.
- cma 2y agoYeah and GPT4o was potentially trained on this test set and if the tried to hold it out it was still likely trained on discussions of the problems.