5 ms·
I am left wondering if it is such a critical task, how even 1% error rate would reduce human review of all outputs.
by crisnoble 4mo ago
I am left wondering if it is such a critical task, how even 1% error rate would reduce human review of all outputs.
- lazide 4mo agoHumans of course will screw at least 1% of the time, at least judged retroactively. The fun part is, if you have non-trivial inputs, even if you don’t change anything, you’ll likely get a different 1% set of errors each time no matter how perfect your judges. 10% seems pretty high, but it really all depends on what you’re evaluating. If it’s all weird edge cases….