8 ms·
Unless you’re at 0 temperature, there is no single token it would have chosen. It’s always picking one of multiple randomly according to a probability distribut
by brokencode 15d ago
Unless you’re at 0 temperature, there is no single token it would have chosen. It’s always picking one of multiple randomly according to a probability distribution.
- northzen 15d agoGive me an example how would you watermark a single short sentence like "I like turtles"?
- qbit42 15d agoWatermarking just alters the pseudorandom number generator. If "I like turtles" was previously the response to your prompt with probability 100%, it will still be so. This is why watermarking is only effective for long strings of text
- northzen 15d agoIt's like the sudden change of a language style and its verbosity didn't happen recently. To random words you pick and provide a sufficient amount of text to vary with random number without losing its meaning you need a text with high entropy.
- qlte 15d agoNothing about watermarking would require padding the response length with pseudo-intelligible Claudese. Regular filler would work fine. Also, it would probably provide higher entropy to write normal human-sounding English instead of reusing a repetitive grab bag of load-bearing phrases. This theory doesn't really make any sense.