5 ms·
With how they’re currently being used we might as well call them bendmarks. Every newly released model is paraded as SOTA showing peak or near peak performance
by catoc 9d ago
With how they’re currently being used we might as well call them bendmarks.
Every newly released model is paraded as SOTA showing peak or near peak performance on cherry-picked bendmarks the model was either fine-tuned on, or tested under specific conditions optimal for that model.