5 ms·
tbh the summarized thinking with encrypted raw thinking is there for many purposes; it is there to: 1. make distillation much harder 2. safety: prevent modifi
by runeblaze 3mo ago
tbh the summarized thinking with encrypted raw thinking is there for many purposes; it is there to:
1. make distillation much harder
2. safety: prevent modifications to the thinking leading to injection attacks.
3. also honestly sometimes the model raw thoughts can be deranged and is not a good user experience (consider the varied audience in the market, etc.)
also often the mass underestimate/the model makers over-estimate how people love distilling models
- soisses 3mo agoThe reasoning blocks are only temporarily part of the context. They aren't part of the context in the next turn anymore so (2) wouldn't really be an issue.