jopsammy

8 ms·

1. 1.▲
   by jopsammy 8mo ago

   This is a deeply unsettling thought. I hope everyone can see this work. We truly have no idea how much resources have been wasted here.
2. 2.▲
   Scientific Insolvency in GPQA and HLE: A forensic audit reveals 58% error rate(zenodo.org)

   3 points by jopsammy 8mo ago|3 comments
3. 3.▲
   by jopsammy 8mo ago

   Author here. I am an independent researcher (originally med background, moved to CS/Physics). I spent the last few weeks manually grading GPQA-Diamond and Humanity's Last Exam (HLE) because my experimental models (DeepSeek-Overclo