LLMs are "readonly" I guess for several reasons:

1. Technical cost of updating the mode.

2. Inability to trust every user's "truth".

3. Ability of AGENT-HARNESSES to learn with the help of the human user.

So agents learn, LLM already knows everything it will ever know, and ESPECIALLY it has already learned how to understand human language.

No 3. above means there is no danger of the LLM getting corrupted. But the agents running on user's machine learn on behalf of that user who shares the machine with them.

>My broader point is just that there's nothing inherent to the structure of LLMs that stops them from updating their weights and continuously learning from environmental feedback in the way humans do, and there's already solid templates for how they could push even further in that direction.

"LLM" is a branded model as a product. Of course it could be anything, as long as it fulfills the product category.

But we live in reality, we can only look at what models are out there and we see that they don't do any of those things and yet we're supposed to act as if these models already do.