5 ms·
LLMs are determistic. Just like everything else computers are capable of doing. Commercial front-ends just hide the random seed parameters.
by mathieudombrock 6mo ago
LLMs are determistic. Just like everything else computers are capable of doing.
Commercial front-ends just hide the random seed parameters.
- kortilla 6mo agoDistributed float math is not deterministic without introducing total operations ordering and destroying performance
- jdiff 6mo agoIt's not usefully deterministic in the way computers usually are. Sensitively identical input can still lead to wildly different outputs even if all randomness is crushed out.