No, my point is that "statistical next-token predictor" is an empty phrase that doesn't really explain much. Markov chains are statistical next-token predictors as well and nevertheless, no one would confuse a markov chain with a conscious being (or deem the generated texts in any way useful for that matter).
The question is how the prediction works in detail, and those details are still being researched, as Anthropic does here, and the research can yield unexpected results.