5 ms·
This reminds me of a prediction game experiment I heard that was described like the following. \* The researchers presented the following to people. f(1) =
by 7777fps 6y ago
This reminds me of a prediction game experiment I heard that was described like the following. \*
The researchers presented the following to people.
f(1) = true
f(2) = true
f(4) = true
f(8) = true
And asked, what is f?
And the people will immediately jump in and test 16, 32, and then proudly declare that
f = x -> x = 2^n for some integer n
Forgetting to test f(3), f(5), etc.
With more examination it turns out that
f = x -> true.
\* I wish I could remember more of the details such as whether it was an experiment or just an illustration of one but it's not an easy thing to search for and I rely on memory and searching too much.
- sethammons 6y agoa similar thing happens with folks when debugging. They assume something, and test their assumption and can happily declare victory. Instead, they should be testing _against_ their assumptions to prove their theory wrong.
- msla 6y ago> Instead, they should be testing _against_ their assumptions to prove their theory wrong. I think this mindset should be taught explicitly starting in grade school. If you have an idea, think how you'd disprove it, and test it. If you can't think of how you'd disprove it, that's a strike against the idea. If you can't test it, that should at least make you suspicious.
- gowld 6y agoIn theory, that's the scientific method, but aomehwt we've evolving this weird grade school science project "scientificky" method in it's place.
- KMnO4 6y agoSounds a lot like Derek Muller’s (Veritasium) video: https://youtube.com/watch?v=vKA4w2O61Xo https://youtube.com/watch?v=vKA4w2O61Xo
- 7777fps 6y agoThanks, that's it! A good video and better than I explained it too. The video says it's inspired by Taleb's Black Swan so I suspect I read it in that too.
- mattkrause 6y agoSomething like this is in Josh Tannenbaum’s PhD thesis, where he calls it “The Numbers Game.” https://dspace.mit.edu/handle/1721.1/16714 https://dspace.mit.edu/handle/1721.1/16714 He uses the game to show that people do something akin to Bayesian updating over possible concepts and have certain intuitive priors (e.g., ‘even numbers’ is a priori more likely than {2, 7, 9, 31}). This is briefly mentioned at the beginning of Kevin Murphy’s Machine Learning: A Probabilistic Approach, so you might also have encountered it there.