4 ms·
Wait, so the trick is they reach into the context and basically switch '</think>' with 'wait' and that makes it carry on thinking?
by codeulike 2y ago
Wait, so the trick is they reach into the context and basically switch '</think>' with 'wait' and that makes it carry on thinking?
- gield 2y agoYes, that's explicitly mentioned in the blog post: >In s1, when the LLM tries to stop thinking with "</think>", they force it to keep going by replacing it with "Wait".
- luc4sdreyer 2y agoYes, that's one of the tricks.
- danans 2y agoNot sure if your pun was intended, but 'wait' probably works so well because of the models being trained on text structured like your comment, where "wait" is followed by a deeper understanding.