We know exactly how they work. When we say they're impossible to analyze, i.e. for particular traits like this, it means that the data model is so big that tracing it would be logistically impossible because of the scale involved and time constraints.
For comparison, suppose you tried to analyze all the nooks and crannies of the Amazon watershed to find out why a particular rock appears at the delta. You could follow it back to the exact tributary, but it'll take forever, and is it worth the effort when you're going to start from scratch with the next rock?
The brain too sits locked inside a bone box and only gets a bundle of unlabeled nerves connecting it to the outside. How can the brain could possibly experience anything, it only sees patters and patterns of patterns never the real thing?
As a species, we do need to up our cable management skills. We're likely not getting augmented humans until we get there.
If I use the word "semantic", do you have a concept of what it means?
If so, can you please share which of your senses have shaped the world experience that inform this concept? What have you smelled, tasted, caressed, that informed this concept outside of words?
If I make up the word "polysemantic", do you need to recall a personal experience of polyamory to understand it, or could you possibly use your concept of "poly" and your concept of "semantic" to figure out this new concept?
Does the material universe perform any other acts than organizing information?
I feel like you're trying to make me argue a position I'm not defending here.
The research goals were and still are clearly distinct from the business goals.
This isn't people merely annoyed with repetition. This is the majority of people realizing the limitations of LLMs. Why would researchers give a flying crap about the ignorance of the business world and the public?