upvote
Just open weights are not enough, I think as a nation state you'd at least want a whole sovereign training pipeline. Otherwise you are stuck when Kimi K4 stops releasing their weights.

But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.

reply
Wouldn't you also want to be able to manufacture some sort of GPU?
reply
I actually think we should be revisiting PMT photomultipler tube construction, and electron-"optical" matrix multiplication.

The annoying part of optical matrix multiplication is the conversion from electronic to optic and back.

Why not use electron-optics for matrix multiplication and use dynodes for amplification.

reply
While an intriguing concept, that doesn't sound like it could scale to the amount of "cores" needed to do the work. Or am I missing something?
reply
We have lots of capable open weights models, but very few have actual datasets and pipelines open for reproducibility. This is a major issue that even if big companies addressed, policies could well just change, as you also acknowledge.

Society can't depend on the whims of the private sector.

reply
> Society can't depend on the whims of the private sector.

Yeah we can, we do it all the time. Nothing in society works without relying on private actors to keep doing what they have always done. Unless you go full soviet command economy, which in fact works worse.

reply
Society and the private sector cooperates, but any technical dependency is detrimental because of monopolization of interests. You don't need to go full soviet, but knowledge in general must be socialized, that includes access to technology.
reply
We literally grant 20 year monopolies on technologies to their inventors and have for centuries and it's fine. The entire economy runs on chips made by like, 3 foundries using lithography machines made by 1 company. I think you are overstating the necessity.
reply
This example proves the exact opposite, that is a national security disaster waiting to happen
reply
Autarky would be a national security disaster manifested. You can't be a modern prosperous society and not rely on either trade nor private enterprise.
reply
I totally agree, hence my previous comment

https://news.ycombinator.com/item?id=49945572

reply
I think you confused "can't" with "shouldn't".
reply
Yes, society in general shouldn't, what I meant to say is that democratic society can't, otherwise it'll devolve invariably into an oligarchy.
reply
The first thought that comes to mind is biases that are baked into the weights.

The next thought is culture-specific workflows, requirements etc that are best trained into weights by people that actually understand those needs.

reply
Like it or not, AI has become part of modern warfare and well as part of the surveillance state (good for crime fighting, not for privacy), so it is an important part of national security, and you'd prefer to be as much self-sufficient for that as you can be.

Not all needs are going to be met by using or finetuning general purpose models, so ability to build your own SOTA ML models (LLMs or not) is also important.

reply
Open weight and -source models aren't without biases. Giving a model away for free would be a good way to distribute an agenda. With a sovereign model you can at least control the agenda and align it with your values.
reply
amazing to see blunt unfiltered commentary about making war and society level propaganda as important and necessary for a political state.
reply