upvote

points

by wcoenen16 hours ago |
comments
upvoteby hobofan16 hours ago|
next
[-]
That's two entirely different types of things that are being verified.

Watermarking checks whether a _specific text_ came from a provider.

PI checks that the text (that you already know came from the provider) was produced with _a specific set of weights_.

PI is mainly useful for AI supply-chain security.

reply
upvoteby seurimas16 hours ago|
prev|
next
[-]
Not to the degree needed for actually verifying the things this verifies. You could probably quite easily produce a non-Claude model that generates text that conforms to Claude watermarking.
reply
upvoteby wcoenen15 hours ago|
parent|
[-]
In the page I linked above, Anthropic explains that they use the techniques from SynthID-Text, where a secret watermarking key is involved. Only Anthropic knows this key, so only Anthropic can produce and detect the watermark. (But they also promised to provide an API through which other parties can check the watermark.)

SynthID-Text paper: https://www.nature.com/articles/s41586-024-08025-4

reply
upvoteby saifelse16 hours ago|
prev|
[-]
I think there are two gaps with the watermark:

- it only gives a high probability that the text was outputted from the model, whereas a crytographic proof is computationally infeasible to forge

- it cannot be traced back to the input. You could "wash" the output from one model into another and it would be watermarked by the latter. With the crytographic proof, if you have the input, output, and "commitment", you can verify your exact input was processed by the model (or so the model provider says).

reply