5 ms·
It looks like true 0-temperature (i.e. determinism) will happen. Here's some good context: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-infe
by danjc 1y ago
It looks like true 0-temperature (i.e. determinism) will happen. Here's some good context: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/ https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
- ayewo 1y agoHN discussion https://news.ycombinator.com/item?id=45200925 https://news.ycombinator.com/item?id=45200925
- FergusArgyll 1y agoBut 0 temp is much less "Creative" and may not be conducive to showing off the AI's latest tricks
- explorigin 1y agoTrue. It depends on the feature you're demoing...but determinism is a VERY DESIRABLE feature for giving demos.