6 ms·

Doesn't prompting "think step by step" simply increase the probability the model will generate its output in the style of places where it saw "step by step" bef

Doesn't prompting "think step by step" simply increase the probability the model will generate its output in the style of places where it saw "step by step" before (eg: tutorial content)? It's not really "deciding" to think step by step. Maybe I am mistaken.

hobs 3y ago
You're not mistaken, its basically perturbing the seed for which the sentence grows.
pegasus 3y ago
It's more than just that. The intermediary steps act as a kind of working memory, ensuring that the model is less likely to get lost in the weeds.