10 ms·
Kolmogorov Complexity looks interesting. It seems to formalize Occam’s Razor and the notion that intelligence = compression.
by prideout 2mo ago
Kolmogorov Complexity looks interesting. It seems to formalize Occam’s Razor and the notion that intelligence = compression.
- Lerc 2mo agoI wouldn't say so about Occam's Razor which is a heuristic. The relationship between compression and intelligence, while not equal is definitely there. It looks like 3Blue1Brown is going to be doing some videos on this aspect.
- nextaccountic 2mo agothere's a way to connect kolmogorov complexity and occam's razor, which is solomonoff induction
- Destructotor 2mo agoIf you find this interesting, you should look into Solomonoff induction. It combines Kolmogorov complexity with Bayes rule to provide a general framework for inductive inference, and naturally formalizes Occam's razor.