4 ms·
that's a very longwinded claim that inference providers are sampling with temperature T=0, but is that even true? a sufficient explanation would be merely sampl
by DoctorOetker 14d ago
that's a very longwinded claim that inference providers are sampling with temperature T=0, but is that even true? a sufficient explanation would be merely sampling at a lower temperature compared to human sources providing similar content
- lensecat 14d agoIt's still probabilistic from a huge dataset while the human mind is not.
- BoredomIsFun 13d agoIt does not matter really - stiffness does lower up to T=0.7, then platoes; even at high temperatures tics/slop-patterns are still there.
- orbital-decay 13d agoThat's pretty model-specific, for example DeepSeek of the v3/R1 era would already start losing coherence occasionally at t=0.7 with no other samplers