Is that actually true though? I think it is an analogy, and as an analogy it seems quite risky because “convex hull” and “linear combination” are technical terms that might give the recipient the impression that it is a technical argument.

Neural nets can extrapolate past their training data, and there is no reason to think LLMs don’t inherit this capability.

The extent to which they are able to do this is the more interesting question!