5 ms·
They could have said "35 out of 36" instead of putting some scary number like "94%".
by yangl1996 5y ago
They could have said "35 out of 36" instead of putting some scary number like "94%".
- MattGaiser 5y agoIs that less scary?
- watwut 5y ago35 out of 36 is scary.
- qweqwweqwe-90i 5y agoYou mean 34/36
- cratermoon 5y agoI shortened the title to fit HN limits. Why do you think "34 out of 36 were wrong" is less scary than "94% were wrong"?
- rhacker 5y agoAnother way to think about that: %99.99 of AIs lose chess against our best human player. When in reality 1 AI consistently beats all Human players every time.
- cratermoon 5y agoOnly if you can go back and demonstrate that the 2 AIs that didn't fail are consistent and demonstrably correct. Otherwise they just got lucky.
- axiom92 5y ago35 out of 36 will be scarier to most people. In behavioral psychology they call this "denominator neglect." https://www.askattest.com/blog/guides/denominator-neglect https://www.askattest.com/blog/guides/denominator-neglect
- jszymborski 5y agoRight, but surely sample size matters.
- deleted 5y ago[deleted]
- yawnxyz 5y agoI think if they flipped it and said "Only 1 out of 36 AI systems evaluated was more accurate than ..." would have a higher impact