This paper from late last year shows that LLMs are not "just" stochastic parrots, but they actually build an internal model of the "world" that is not programme

This paper from late last year shows that LLMs are not "just" stochastic parrots, but they actually build an internal model of the "world" that is not programmed in, just from trying to predict the next token. https://ar5iv.labs.arxiv.org/html/2210.13382 https://ar5iv.labs.arxiv.org/html/2210.13382 PS: More research has been done since that confirmed and strengthened the conclusion.