Right — they're not reasoning, they're generating text that statistically models reasoning. Anyone who says differently is selling something.
replyAs the meme goes, "they are the same picture".
replyLanguage has reasoning encoded within it.
replyIt certainly does. But so too do complex neural network functions, as do attention mechanisms.
replyThat is what a base model does. After RL it is a very different thing, and anyone who says they know what it is, is naive or dishonest. These things are grown, not made, and we really do not understand how they work in many important ways.
replyYeah, but they’re not magic; we can still do experiments and see what happens. Anthropic did a lot of work on this and showed that they’re not accurately describing their reasoning process.
replyOf course, the fact that they have to do that proves my point.
reply