upvote
Experimentation leads to experience

Of course it does, but only after the fact. You don't have any experience of the result of the experiment before you perform it.

Sure, they can't have apples fall on their heads like Newton had but they can totally observe the apple falling on someones head in a video

I have strong doubts that LLMs have any understanding whatsoever of what's happening in images (let alone videos). The claim (I've sometimes heard) that they possess a world model and are able to interpret an image according to that model is an extremely strong one, that's strongly contradicted by the fact that they: a) continue to hallucinate in pretty glaring ways, and b) continue to mis-identify doctored (adversarial) images that no human would mis-identify (because they don't drastically alter the subject).

reply