upvote
Only if you think in terms of short term gains, but thinking in the long run, doesn't really matter if these models are crap today, all models will eventually be obsolete, unless we plateau hard on every aspect of the tech.

What matters is to have good sovereign models in 5, 10, 20 years time.

reply
I'm curious why you think sovereign models matter that much if open source ones exist (unless that stops at some point). Sovereign model hosting services, yes.
reply
Just open weights are not enough, I think as a nation state you'd at least want a whole sovereign training pipeline. Otherwise you are stuck when Kimi K4 stops releasing their weights.

But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.

reply
Wouldn't you also want to be able to manufacture some sort of GPU?
reply
I actually think we should be revisiting PMT photomultipler tube construction, and electron-"optical" matrix multiplication.

The annoying part of optical matrix multiplication is the conversion from electronic to optic and back.

Why not use electron-optics for matrix multiplication and use dynodes for amplification.

reply
While an intriguing concept, that doesn't sound like it could scale to the amount of "cores" needed to do the work. Or am I missing something?
reply
We have lots of capable open weights models, but very few have actual datasets and pipelines open for reproducibility. This is a major issue that even if big companies addressed, policies could well just change, as you also acknowledge.

Society can't depend on the whims of the private sector.

reply
> Society can't depend on the whims of the private sector.

Yeah we can, we do it all the time. Nothing in society works without relying on private actors to keep doing what they have always done. Unless you go full soviet command economy, which in fact works worse.

reply
Society and the private sector cooperates, but any technical dependency is detrimental because of monopolization of interests. You don't need to go full soviet, but knowledge in general must be socialized, that includes access to technology.
reply
We literally grant 20 year monopolies on technologies to their inventors and have for centuries and it's fine. The entire economy runs on chips made by like, 3 foundries using lithography machines made by 1 company. I think you are overstating the necessity.
reply
This example proves the exact opposite, that is a national security disaster waiting to happen
reply
Autarky would be a national security disaster manifested. You can't be a modern prosperous society and not rely on either trade nor private enterprise.
reply
I totally agree, hence my previous comment

https://news.ycombinator.com/item?id=49945572

reply
I think you confused "can't" with "shouldn't".
reply
Yes, society in general shouldn't, what I meant to say is that democratic society can't, otherwise it'll devolve invariably into an oligarchy.
reply
The first thought that comes to mind is biases that are baked into the weights.

The next thought is culture-specific workflows, requirements etc that are best trained into weights by people that actually understand those needs.

reply
Like it or not, AI has become part of modern warfare and well as part of the surveillance state (good for crime fighting, not for privacy), so it is an important part of national security, and you'd prefer to be as much self-sufficient for that as you can be.

Not all needs are going to be met by using or finetuning general purpose models, so ability to build your own SOTA ML models (LLMs or not) is also important.

reply
Open weight and -source models aren't without biases. Giving a model away for free would be a good way to distribute an agenda. With a sovereign model you can at least control the agenda and align it with your values.
reply
amazing to see blunt unfiltered commentary about making war and society level propaganda as important and necessary for a political state.
reply
For the same reason it didn't matter whether coach makers were able to build carriages that went 5% faster when the automobile was introduced, and for the same reason it won't matter if VW and Mercedes are going to improve their EV lineup in the next 5, 10, 20 years time. Their window of opportunity will be long gone and the momentum elsewhere; most probably, the market will even have evolved further by then.
reply
Ford started mass producing cars in 1913, and yet there are plenty of car companies that started production 20+ years later and are still relevant.
reply
I came here to say the same thing.

AI is here to stay - will be around for hundreds/millions of years. Whether company A is a few years ahead of company B is irrelevant. In 10 years time company A, who started the industry, may be gone completely - also irrelevant.

reply
> VW

VW EV sales are up in South America, Canada and Europe. It's true that their total global numbers are down, but that's mainly because they lost like 30% in China. Which obviously sucks considering how big the Chinese market is, but then, the Chinese market is it's own sort of thing.

Don't get me wrong, I think your point is valid for a lot of traditional European car brands. Mercedes is certainly one of them which has lost it's "our engines are nicer" brand, but I suspect VW is one of the brands that will do just fine. Especially with the id polo coming out next year.

reply
> Mercedes is certainly one of them which has lost it's "our engines are nicer" brand

Mercedes is doing something interesting with its level 3 DRIVE PILOT. As far as I know, it's the only autonomous driving system/auto pilot on the market that actually takes full legal responsibility for the vehicle and its actions. If you put a new Mercedes in self driving and it crashes, Mercedes takes full liability.

Yes, it currently only goes up to 100 kph and it will buzz you to take over if it can't guarantee prefect safety anymore. But this approach is really the only one I think is interesting. All this self driving shit is worthless to me if I'm still liable in the end. So I respect Mercedes for putting their money where their mouth is.

reply
maybe to have a global market share, but there are plenty of players that picked up pace when they “decided” to build cars (Japan? South Korea? and many more) or electronics. Having a good sovereign model in 10/20 years might not need having the absolute best there is, and perhaps future optimizations will make building one not as prohibitively expensive as it is today. Keeping some sort of homebrew capacity now is definitely better than having none
reply
> it won't matter if VW and Mercedes are going to improve their EV lineup in the next 5, 10, 20 years time

I mean, given the fuel prices it would be very nice, alongside more charging infrastructure in the EU. :(

Not to detract from the overall point, though to be honest, it's probably worthwhile to do improvements and refinements with the current technology, even if the future holds something vastly different. Both cause of gaining expertise and also maybe an improvement or two along the way, that might carry forward.

Like I haven't seen many steam locomotives around and for me the difference between saturated steam engines and superheated ones isn't very material in regards to transportation, but the latter is used in modern turbines.

reply
There are many "steam" locomotives around in China and India, but you just don't see them.

Coal is burned and converted to electricity in coal power plants and the electricity is used to move the electric locomotives around.

Even with distribution losses, the thermal efficiency of coal power plant -> electric network -> electric train is much higher then the old steam locomotives (Only about 5% of the potential energy produced by a steam locomotive’s boiler is translated to the wheels in the form of actual driving power.)

reply
When you mention a window of opportunity, what do you mean by that? A window of opportunity for what?
reply
And who are you, exactly?
reply
Well, they're "Head of Engineering @ matchory.com"

And who are you to be asking such questions?

reply
Someone mad at this random guy who can't even fix his de domains SSL cert (cloudflare of course) destructively shitting on any efforts at doing something good.

Someone that builds things instead of merely "managing".

Someone pissed by this exact style of default github pfp business-person ruining this country. If they haven't left for SV already, in which case I hope that they will stay there.

reply
So many assumptions there. For one, I’m absolutely proud to be founding engineer of a German company that’s staying one, and I’m the first to make a stand for European technology. You just won’t get a high five from me for a company that isn’t managed well, does not deliver on their promises, and ultimately doesn’t really serve the goal of European AI independence well.
reply
Feel your pain but ad hominen isn't the way my dude
reply
Dude I did not start with

> Aleph Alpha is just a sad joke by now.

And this isn't ad-hominem for lack of factual critic. The personal stuff _is_ the reason. How else do you call out someone driven by ego without mentioning them and their ego?

The guy is only ego. There is no substance to attack.

reply
> And who are you, exactly?

this is, because it can mean so much stuff that you can't really tell you are calling out their "ego" or just trolling.

Until you can at least open yourself to the possibility that there are better more inviting ways to talk to people online, you'd think this is just the natural way people talk online, but I'd say it's not. It's just an aesthetic choice.

reply
We're not going to discuss this.

If you truly think that I am the problem deep down in this nested subthread that violates the spirit and letter of the rules of the platform, I have zero faith in the calibration of your perception.

reply
Good, leave faith for God, question everything, but there is room there for improving your communication whether you are ready for this conversation or not
reply
In 5 years we'll have superintelligence, and thinking on 20 year timelines is simply absurd.
reply
[dead]
reply
Would you mind substantiating these claims a bit?
reply
It's not that talent isn't there anymore. It's that retards are at the helm everywhere and therefore talent is running away the first chance they have.
reply