upvote
> they are literally trying to build a superpower that exceeds the impact of the atomic bomb

I think people (the government, powers that be) have given away what they really think by their actions. There are few that take this seriously. The “exceeds the impact of the internet” view has much more support based on investment, but the “danger” aspect does not based on actions. If this was a company making novel prions or whatever that were outside regulation but obviously dangerous, government would be all over them. What regulation we do see is much more power grab than mitigating real danger

reply
> but they are literally trying to build a superpower that exceeds the impact of the atomic bomb

Yes, it's a Great Power competition right now, much like the Space Race, Atomic Bomb, etc.

reply
Somebody's going to build it. Not building it isn't an option. Would you rather the Chinese built it? The Russians? The Europeans? The Indians? A loose coalition of random hackers on the Internet, like the ones who build Linux?
reply
Of course it is an option. Not doing your species in is always an option.
reply
Yes?

What's wrong with what the Chinese have already built? It's not theoretical in that case. GLM, and Kimi are running on my infra right now, and that's something that I can never do with OpenAI's models.

As for the others, what would be wrong about European AI? I'm not European, but I find them to be a continent of fine people, with strong ethical values, there's no reason they can't take the lead on this piece of technology while the US deals with its rather more pertinent electoral and healthcare issues.

reply
At least random hackers seem to have codes of ethics.
reply
Well, they'd presumably be different hackers than the ones who work on Linux. We don't know what would motivate them. Maybe they'll do it because they consider the next stage of man's intellectual evolution to be too important to leave up to a couple of American companies and the Trump administration. Maybe they'll do it for the proverbial lulz.
reply
> Somebody's going to build it. Not building it isn't an option.

It turns out that is, in fact, an option. Even if someone else will do a bad thing, it does not make it acceptable for you to do said bad thing.

reply
That's a pretty weak argument. It is like saying, "somebody's going to kill all the polar bears. Not wiping them out is not an option. If we do it, then at least we get to keep the cool bearskins."

That's a persuasive argument only if you really really want big white bearskins or maybe if you're embedded in a society with an unhealthy level of dependence on fur trading.

reply
It is sad to see how many times this narrative will continue to work. Across generations, humanity learns no lessons at all.
reply
I'm being descriptive, not prescriptive. The "narrative" isn't intended to "work," except as a statement of fact.
reply
Logical fallacy, of the worst kind.

Firstly artificial superintelligence is a science fiction, it does not exist and it cannot be built using existing technology.

Second, plenty of stuff is possible to build, and is not built for one reason or another no matter how powerful. We never built our nukes in space for example. And there is exactly one reason why nukes in space was never built, and that reason is that we agreed not to.

reply
Firstly artificial superintelligence is a science fiction, it does not exist and it cannot be built using existing technology.

By what authority do you claim this? Your school of thought has a really shitty track record of late.

reply
The same authority that allows me to claim that teleportation transporters, hyperdrives, and holoemitters do not exist and cannot be built using existing technology.
reply