it's more like someone writing about a character getting angry in a book... I don't think anyone would argue that a character actually experienced anger, right? there's no subjectivity in that experience... it's the output of someone else's experience on what they'd expect the character's reaction to be, not a genuine outcome of that character's experience
That's the same here, LLMs are outputting the result of the written experiences of others... not its own experience, which it does and can not have.
Put another way, it only "knows" what it just output by reading it... it doesn't actually build experience to know anything.
We might be closer than ever to building these things, but they're not here yet.
But also, what's the difference between having the memory of a prior experience and actually having gone through that experience?
For humans, reading a book about an experience and living an experience is different, because for a human the actual experience has so many more inputs attached (the sights, the smells, the sounds, etc).
For LLMs, when they train on a memory they can actually truly recapture that memory entirely by replaying the senses exactly. And LLMs are no longer limited to just text, they can do sound and video as tokens too.
Though, it's not clear why that matters to a consciousness. Whether your inputs are of one type or two or two hundred, there's no clear indication that a specific number is required as a catalyst.