Exams are usually discussed and part of the corpus though right? Performance on novel problems are really the only good metric and those decay really quickly ac

Exams are usually discussed and part of the corpus though right? Performance on novel problems are really the only good metric and those decay really quickly across models once they’re known, like the pelican on a bicycle test