4 ms·
But it's not relevant as a metric to gauge distance to human intelligence. Humans see individual letters, LLMs do not. If I asked you the relative activation of
by hackinthebochs 13d ago
But it's not relevant as a metric to gauge distance to human intelligence. Humans see individual letters, LLMs do not. If I asked you the relative activation of the cones in your retina as I showed you some solid color image, you couldn't do it. You simply do not have cognitive access to that information. But that says nothing about your intelligence.
A more accurate test would be to give it a list of words (or anything represented as a single token) and ask it how many times that token appeared. I'm sure they have no trouble at that task.
- bvanheu 13d agobut a human doesn't attempt to make up an answer, the human knows that he doesn't know?
- hackinthebochs 13d agoYes, they have some alien failure modes. But that should be expect, they are an alien intelligence. I might be willing to grant that a lack of ability to reflect on its own level of knowledge is a demerit to it being generally intelligent. But then again it is largely an artifact of training. I suspect if there were a guessing penalty during pretraining they would develop or more readily communicate the strength/reliability of their knowledge.
- slidehero 13d agothis is so false that Dunning and Kruger invented a name for it
- yunwal 12d ago> If I asked you the relative activation of the cones in your retina as I showed you some solid color image “I don’t know”
- hackinthebochs 12d ago[dead]