5 ms·
There is already some intentional randomness in token selection, because it actually improves the quality of responses if you intentionally don't always pick th
by shawnz 1mo ago
There is already some intentional randomness in token selection, because it actually improves the quality of responses if you intentionally don't always pick the most likely next token.
You can hide data in that randomness without impacting the quality of the response by using a sufficiently "random looking" pseudorandom bit stream instead of real random numbers.
I previously worked on a project to do that here: https://github.com/shawnz/textcoder https://github.com/shawnz/textcoder
- KoolKat23 1mo agoGood point, very interesting. Thanks!
- KoolKat23 1mo agohttps://x.com/Koolkat6000/status/2087502146556100812?s=20 https://x.com/Koolkat6000/status/2087502146556100812?s=20 A small anecdotal example to demonstrate how the response lacks depth. It's imperceptible to most. You'll probably see through it in your own field of expertise, if you had both answers. Uncanny valley type thing.