6 ms·
LLMs are 100% deterministic. The facade of randomness is injected solely by a superfluous rng factor.
by ANewFormation 1y ago
LLMs are 100% deterministic. The facade of randomness is injected solely by a superfluous rng factor.
- mdp2021 1y agoEven if in the forward pass there would be no "temperature" tilting, the NN training would still be performed through different processes on different implementations, making the outputs "personal".