This is the whole Chompsky/Kant thing - the idea of "Poverty of the Stimulus" innate structures. You didn't "learn" a word/concept by direct exposure, but by socialization, association, emotional connections, vibes. LLM seem to learn the hard way.

The Saussure idea of the differential nature of language seems relevant here too: words aren't just lists of things you look up, they are connected to each other and distinguish themselves by being slightly different from the other elements of the clusters they belong to.