5 ms·
Do open "source" models have have this watermarking enabled? How do you know?
by NewsaHackO 1mo ago
Do open "source" models have have this watermarking enabled? How do you know?
- nonethewiser 1mo agoIt doesn't matter if they are watermarked if there is no ability to verify the watermark.
- bonoboTP 1mo agoThis particular watermark doesn't live in the weights, but in the sampling process, so you can turn this one off in an open source LLM.
- NitpickLawyer 1mo agoThe way they explain it implies they're using this at the sampler level and not trained into the weights themselves. So unless you're using an inference library that does this, the open models will not have this kind of a watermark. > When watermarking is used, choices are still made at random, but the source of the randomness is different. Instead of using an arbitrary random number generator to pick the next word, watermaking uses the key and a few words that come before to settle what word the model should pick. > the watermark only changes the source of the randomness used to pick among words.