upvote
Yes. This completely explains sycophancy at least.
reply
So question then, why is it so hard to make an ai that doesn’t do these things? And why do Claude and ChatGPT have the same -isms? They’re both doing the same a/b post training with the same decisions?
reply
It would require changing humans first.
reply
You don't blame the puddle for taking the shape of the hole.
reply
There's layers, some of token selection is fingerprinting https://github.com/google-deepmind/synthid-text
reply
Yeah, but I understand that fingerprinting is essentially a pseudorandom overlay onto a pseudorandom base signal. And unless you have access to both the random number generators and the weights, I don't think you can detect it?

So "fingerprinting" operates on a totally different and basically invisible level, as opposed to the obvious stylistic patterns that the average programmer can identify in about 2 sentences.

reply