upvote
Humans learn to be a next token predictor as a kid when they learn to speak, an LLM cannot learn to be a next token predictor or anything of the sort, we have no clue how you could have an LLM learn human language just based on a thousands conversations with a human.

You don't see how that is very different? For an LLM to be as smart as a human it has to be able to learn like a human. Like you don't evaluate how smart a human is based on how much he knows, you evaluate it based on how fast he learns. And LLM are so bad at learning its ridiculous, they lack that part of the brain that lets humans be smart and learn so fast and easily.

reply
> For an LLM to be as smart as a human it has to be able to learn like a human.

"For a plane to fly as well as birds it has to be able to flap its wings".

"For a submarine to swim as well as a fish it has to be as light as fish".

reply