8 ms·
What kind of nonsense is this? Matrix math is entirely deterministic.
by trollbridge 15d ago
What kind of nonsense is this? Matrix math is entirely deterministic.
- shakna 14d ago> As the examples demonstrate, although rounding follows deterministic rules, non-associativity introduces nondeterminism, which is further amplified by the larger rounding error of BF16. This becomes particularly relevant in the parallel computations performed in GPUs during LLM inference. Ya might want to just read the paper...