5 ms·

Here is a definite scientific nail down and solve for non-determinism in LLM outputs (Mira Murati's new outfit but really credit the author) https://bff531bb.c

Here is a definite scientific nail down and solve for non-determinism in LLM outputs (Mira Murati's new outfit but really credit the author) https://bff531bb.connectionism.pages.dev/blog/defeating-nondeterminism-in-llm-inference/ https://bff531bb.connectionism.pages.dev/blog/defeating-nond...

gwern 1y ago
Requires a login?
- nulltype 1y ago
  Looks like it's probably https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/ https://thinkingmachines.ai/blog/defeating-nondeterminism-in...