I guess I just don't have an intuition for why that is different from what it does for non-"spatial" things. Like the fact that it works is still because it produced the code it did token by token. Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.
reply>Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.
replyAre you sure about that? Presumably the spatial concept of "inside" and the computer memory concept of "inside" have different contextual embeddings in an LLM, much in the same way that neural activation patterns vary in the human brain when we reason about different domains.
You are correct. It’s important not to let hype peddlers imply AI possesses consciousness.
reply[dead]
reply