Yeaaah, and this, of course, is worth it, because it leads to you being able to download a near frontier model. Don't get me wrong, long-term humanity is probably better of with science with little regards to pesky things like ethics and provenance, but we also have a tendency to not fully realize the downstream or wider effects until way too late.

And sure, there is a lot of reasons to go with keeping your software proprietary too, I'm not trying to claim otherwise, same with training data. It's just that usually we don't call proprietary software "open source" unless it is open source, regardless of the reasons someone keep it proprietary or not, could be for whatever reason really.

Not that what you've written isn't the case. However, in addition to what you've written, (or probably even before what you've written), there's the fact that everything they're training on is stolen IP. Same with US LLM labs.

Let's not kid ourselve's about where the training data is coming from. They are not asking artists, writers, coders, content creators, etc etc etc for permission to use their creations.

Anthropic, Moonshot et al are doing incredible things, but we shouldn't gloss over the costs. Both present and future costs are kind of enormous.