4 ms·
Library outperforms student... more news at 9
by OhioMan2943 4mo ago
Library outperforms student... more news at 9
- apparent 4mo agoExcept the library outperformed the professors, which is quite a bit more impressive.
- lern_too_spel 4mo agoThis was an open book test. The real problem with this study is that winning the most head-to-head preference tests is not the right metric. It doesn't much matter if two answers are right, and one is written a little better than the other. It matters quite a lot if one answer is right and another is wrong. The authors point out that this other metric was computed in prior work and incorrectly dismiss it as being not as good as winning percentage in head to head competitions. The cited prior work shows that the models fare poorly on that metric. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5166938 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5166938