5 ms·
You are aware that Claude already doesn't choose the most probable token, right? That's literally what the temperature parameter means. It picks tokens at rando
by sisyphus15 1mo ago
You are aware that Claude already doesn't choose the most probable token, right? That's literally what the temperature parameter means. It picks tokens at random (from the list of most probable next tokens), increasingly so as the temperature goes up. This has always been the case. And now, with the watermarking, it will simply go from random to pseudo-random, adding some patterning.
There isn't any effect on the quality or precision of the output. Nothing changes in practice.