5 ms·
"LLMs are actually pretty deterministic, so there is no need to do more than one attempt with the exact same data." Is this true? I remember there being a rand
by ncgl 10mo ago
"LLMs are actually pretty deterministic, so there is no need to do more than one attempt with the exact same data."
Is this true? I remember there being a randomization factor in weighing tokens to make the output more something, dont recall what
Obviously I'm not an Ai dev
- koakuma-chan 10mo agoIn my experience, the response may not be exactly the same, but the difference is negligible.