Because the degree of realism in a video is determined by implicit knowledge of concepts like "in front of", "behind", "next to", "inside", "outside", "between", "occluded by", etc. as well as distances, angles, and the relative size of objects when viewed from a perspective.
replyI guess I just don't have an intuition for why that is different from what it does for non-"spatial" things. Like the fact that it works is still because it produced the code it did token by token. Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.
reply>Whether its dealing with, e.g., "beside the rock" or "in the array", it's doing the same kind of inferential activity.
replyAre you sure about that? Presumably the spatial concept of "inside" and the computer memory concept of "inside" have different contextual embeddings in an LLM, much in the same way that neural activation patterns vary in the human brain when we reason about different domains.
You are correct. It’s important not to let hype peddlers imply AI possesses consciousness.
reply[dead]
reply