7 ms·
> natural language used to be one of the metrics of AGI what if we have chosen a wrong metric there?
by pyzhianov 1y ago
> natural language used to be one of the metrics of AGI
what if we have chosen a wrong metric there?
- 1718627440 1y agoI don't think we have. Semantic symbolic computation on natural languages still seams like a great way to bring reasoning to computers, but LLMs aren't doing that.
- bheadmaster 1y ago> Semantic symbolic computation on natural languages still seams like a great way to bring reasoning to computers, but LLMs aren't doing that. But they do close a big gap - they're capable of "understanding" fuzzy ill-defined sentences and "infer" the context, insofar as they can help formalize it into a format parsable by another system.
- skydhash 1y agoThe technique itself is good. And paired with a good amount of data and loads with training time, it’s quite capable of extending prompts in a plausible way. But that’s it. Nothing here has justified the huge amount of money that are still being invested here. It’s nowhere near useful as mainframes computing or as attractive as mobile phones.
- grey-area 1y agoThey do not understand. They predict a plausible next sequence of words.
- bheadmaster 1y agoI don't disagree with the conclusion, I disagree with the reasoning. There's no reason to assume that models trained to predict a plausible next sequence of tokens wouldn't eventually develop "understanding" if it was the most efficient way to predict them.
- grey-area 1y agoThe evidence so far is a definite no. LLMs will happily produce plausible gibberish, and are often subtly or grossly wrong in ways that betray complete lack of understanding.