4 ms·

Arrows of Time for Large Language Models

• nyoncore 3y ago
  Isn't it obvious that since LLM are trained to predict the next word they do better than to predict the previous one?
  • deleted 3y ago
    [deleted]
  • frotaur 3y ago
    In the paper it is mentioned that the LLMs predicting the previous token are indeed pre-trained in this way, so it is not true that the difference is obvious.
• tianlong 3y ago
  There is a link with entropy creation?