Are most of these distilled from other models? I'm talking about publicly owned and fully open foundation models, which will require significant government-level investment into GPU farms and training.

No chance of it happening in the US due to lobbying pressure, but maybe in a more civilized country... (unless a distributed SETI@home-type architecture becomes viable)