6 ms·
In my own experiments with OpenAI's GPT-4 API with temperature set to zero, I was still not getting deterministic outputs, with some small variations between co
by soroushjp 3y ago
In my own experiments with OpenAI's GPT-4 API with temperature set to zero, I was still not getting deterministic outputs, with some small variations between completions. Not sure why, and I haven't had a chance to dig further or talk to their team about why and how this happens.
- mirekrusin 3y agoNon-determinism in GPT-4 is caused by Sparse MoE [0] [0] https://news.ycombinator.com/item?id=37006224 https://news.ycombinator.com/item?id=37006224
- deleted 3y ago[deleted]