> pluggable knowledge banks.

plugs in knowledge bank LLM: ... I know kung fu.

Agreed, I suspect that LLMs in the future will have separate (possibly standardized) decoding/encoding layers that plug into logic layers.

This is interesting. Would this mean less space for hallucination as well (depending on the breadth of knowledge applied to a specific task)?