5 ms·
If being probabilistic prevented learning deterministic functions, transformers couldn’t learn addition either. But they can, so that can't be the reason.
by skinner_ 11mo ago
If being probabilistic prevented learning deterministic functions, transformers couldn’t learn addition either. But they can, so that can't be the reason.
- wat10000 11mo agoPeople are probabilistic, and I've been informed that people are able to perform multiplication.
- ddingus 11mo agoYes, and unlike the LLM they can iterate on a problem. When I multiply, I take it in chunks. Put the LLM into a loop, instruct it to keep track of where it is and have it solve a digit at a time. I bet it does just fine. See my other comment as to why I think that is.
- krackers 11mo agoAre you sure? I bet you if you pull 10 people off the street and ask them to multiply 5 digit by 5 digit numbers by hand, you won't have a 100% success rate.