> What is the difference between what LLM's do and "true" understanding?
replyThe thing where you can understand the meaning of this sentence without first compiling a statistical representation of a 10 trillion line corpus of training data.
Unless you're an NPC of course.
I mean brains get a lot of training data too in order to understand language. I don't think you provided a relevant difference.
replyOr rather, maybe I don't understand what you mean :)
When you think about the word apple and what it signifies, what do you experience? Is there a feeling of "appleness"? Do you think that sense of meaning is equivalent to the numerical weights of an LLM?
reply