It's a very unintuitive algorithm, and is pretty clever.
replyI recommend reading up on it: https://www.nature.com/articles/s41586-024-08025-4
But no, it only ever picks tokens that are in the probability distribution of the last layer, and it might have picked anyway.
Unless you’re at 0 temperature, there is no single token it would have chosen. It’s always picking one of multiple randomly according to a probability distribution.
replyGive me an example how would you watermark a single short sentence like "I like turtles"?
replyWatermarking just alters the pseudorandom number generator. If "I like turtles" was previously the response to your prompt with probability 100%, it will still be so. This is why watermarking is only effective for long strings of text
replyUnless you’re running at temperature 0, there’s not one single token that the model definitely would have chosen each time.
reply