upvote
It’s optimizing for good writing. Therefore, it believes its outputs are good. Therefore, it believes inputs that look like its outputs are good.
reply
This minus the word "believe". It's explainable simply by marching by similarity
reply
It would need to be researched, but I wonder if it ends up being something that happens at the token level?
reply