5 ms·
Because playing a video game isn’t relevant to which AI people might want to use.
by thereitgoes456 12d ago
Because playing a video game isn’t relevant to which AI people might want to use.
- dannyw 11d ago"Video game" is the medium, the challenge and test is figuring out how to win; when given no instructions, and specifically designed to be private. ARC-AGI takes it very seriously: they've never tested Fable, because they won't run on the eval set without ZDR. Another possible way to look at this is that any benchmark reporting Fable scores is potentially contaminated.