upvote
reply
Invisibilia's episode was my first exposure to it.

https://www.npr.org/programs/invisibilia/378577902/how-to-be...

The man posits that clicking is instinctual for blind people but they are told to quiet down in class and most never develop their echolocation abilities

reply
Wow. Thank you.
reply
LLMs also have other inputs, like audio and images. They get encoded (just like a human eye encodes an image) and passed to the weights.
reply
So a blind person only can describe lava to you after they touched and heared it?
reply
A blind person has touched warm and hot things and gotten burned before, and then they are told lava is this molten liquid that is even hotter than anything they have touched. That is enough for them to understand.

A blind person that never touched a hot object wouldn't really know though, there is a reason we dismiss talk from people who lack experience.

reply
You don't know that. Yo don't know what someone would think if you tell them the general concept of cold and warm.

The reaction you should have, the feeling etc.

I asked chatgpt how it would describe a scene without mentioning temperature. It was very good in describing what a human would describe.

I'm aware of the bias we have against LLMs but I think people just underestimate how much data is there.

I'm not saying a robot wouldn't be better with this information or an LLM and they actually use temperature sensors for robots so they can control movement speed and dexterity with overheating elements but the gap is small.

reply