8 ms·

I'm confused what you mean by the query of adding 55 + 66. I asked 5.6 Sol on Medium (but pretty sure any model would work at any level) this query: "Can you a

by intenex 14d ago

I'm confused what you mean by the query of adding 55 + 66. I asked 5.6 Sol on Medium (but pretty sure any model would work at any level) this query: "Can you add 55 to 66 and explain how you reached that output result" And received this answer: "55 + 66 = 121. Add the tens: 50 + 60 = 110. Add the ones: 5 + 6 = 11. Combine them: 110 + 11 = 121." Do you mean something else? Do humans do something better than this?

Yizahi 13d ago
But that's not how LLM program actually did calculation, like not even close enough to claim variability or something. So what it does, is generated a whole load of bunk, in this example what humans could do to add two numbers. In other words, this supposed AGI can't explain what it is doing, at all. This is in my opinion at minimum one critical sign that there is no intelligence on the other side of the glass, yet.
- seventhtiger 13d ago
  Can any human explain how they do 55+66 to the same standard?
  - Yizahi 13d ago
    Of course we can, we can simply speak out what steps are we doing to add numbers and it will correlate pretty much exactly to the actual actions done. Can tell to a similar query that first I add 5+6 and get 11, then I write down 1 and carry 1 to the next decimal space. Then I add 5+6 plus 1 I carried, then get 12 and write 121 as a final answer. That's the description of the real addition process I did in my head. LLMs on the other hand will do some pretty unconventional stuff, like estimating the closest numbers not exactly matching, then evaluating probability spread of their low-precision sums, create some lookup tables, then do some dances combining this and that, making a higher precision estimations in a sequence, and eventually arriving to a single result. But no LLM will reply with these procedure steps to the simple "explain how you did it" query, simply because it is way less probable answer, therefore it won't be chosen.

by intenex 14d ago

Yizahi 13d ago

But that's not how LLM program actually did calculation, like not even close enough to claim variability or something. So what it does, is generated a whole load of bunk, in this example what humans could do to add two numbers. In other words, this supposed AGI can't explain what it is doing, at all. This is in my opinion at minimum one critical sign that there is no intelligence on the other side of the glass, yet.

seventhtiger 13d ago
Can any human explain how they do 55+66 to the same standard?
- Yizahi 13d ago
  Of course we can, we can simply speak out what steps are we doing to add numbers and it will correlate pretty much exactly to the actual actions done. Can tell to a similar query that first I add 5+6 and get 11, then I write down 1 and carry 1 to the next decimal space. Then I add 5+6 plus 1 I carried, then get 12 and write 121 as a final answer. That's the description of the real addition process I did in my head. LLMs on the other hand will do some pretty unconventional stuff, like estimating the closest numbers not exactly matching, then evaluating probability spread of their low-precision sums, create some lookup tables, then do some dances combining this and that, making a higher precision estimations in a sequence, and eventually arriving to a single result. But no LLM will reply with these procedure steps to the simple "explain how you did it" query, simply because it is way less probable answer, therefore it won't be chosen.