5 ms·
Andrej Karpathy states that LLMs are highly general purpose technology for statistical modelling of token streams [1]. For example, comma.ai uses transformers i
by britannio 2y ago
Andrej Karpathy states that LLMs are highly general purpose technology for statistical modelling of token streams [1]. For example, comma.ai uses transformers in their self-driving model which is far from a linguistic task.
[1] https://x.com/karpathy/status/1835024197506187617 https://x.com/karpathy/status/1835024197506187617
[2] https://www.youtube.com/watch?v=-KMdo9AWJaQ&t=1010s https://www.youtube.com/watch?v=-KMdo9AWJaQ&t=1010s