4 ms·
Except Clarke wasn't referring to the black-boxiness of said advanced tech, was he?
by gflan 3y ago
Except Clarke wasn't referring to the black-boxiness of said advanced tech, was he?
- michaelmior 3y agoNot explicitly, I think no. But in some sense, yes. Arguably any tech which we don't really understand is a black box. I think the lack of understanding how something works is a large part of the "magical" effect.
- visarga 3y agoI think LLM smarts is actually language smarts. Language is accessible, we can track how it creates these capabilities.
- michaelmior 3y ago> we can track how it creates these capabilities. Could you explain what you mean here? To the best of my knowledge, there hasn't been much success in successfully explaining how LLMs actually work? Of course we know all the low level mathematical details, we built them. But my understanding is that we don't really know much about the structure of LLM parameters and how they relate to the concepts the model is supposedly learning.
- piecerough 3y agoNice, one would expect so. Though if you think more deeply about it, I think not. The language itself is the manifestation of capabilities, but the process exhibiting them is the underlying system, eg. neural nets or human brain.