10 ms·
The test is very simple but people simply don't realize it. When LLMs are good at Prolog, it means they're good at logic, which means they're good at reasoning
by Vampiero 2y ago
The test is very simple but people simply don't realize it.
When LLMs are good at Prolog, it means they're good at logic, which means they're good at reasoning. Until then, you can't trust them.
- daveguy 2y agoWhat exactly do you mean by "good at Prolog"?
- Vampiero 2y agoIt means being good at first order predicate logic. And possibly higher order too when you consider `call/n` and lambdas. It means being good at generalization, at reasoning in causal terms, at understanding structure and grammar, at encoding problems as graphs and querying them for solutions, and much more. Basically it's what current LLMs lack. They're good at spewing coherent text but they lack the building blocks of reason, which are made of logic, and which confer the quality of being consistent. A implies B.