If you believe it will be developed regardless and that that there's a 30% chance of doom, they want a company prioritising safety research to be the one threading that needle.
Autonomous flying killbots: exist.
Once somebody scientifically prove and shows any kind of self-improving software we can start bothering about it. I pretty sure everyone trying to do it and it would be all over the news once its here.
Can the thing enter into an runaway looop while improving the model itself -- probably not, not without us not noticing at least
As for killbots they are all over frontline, but dont actually need particularly smart LLMs to run - some good enough segmentation, pattern recognition on smartphone SOC is enough to kill hundreds of thousans of people.
It will start moving really fast once the automatically targeted anti-drone turrets get to production pipeline. Now calling it anti drone is a bit of self delusion -- pattern recogniser gonna pattern recognise whatever it's told to, including "anything moving that emits EV or IR and not broadcasting the friendly signal hard enough".
I wonder how it is supposed to behave if the invasive fauna decides to call it quits and surrender. Should the robot following the Convention or is it yet another accountability sink?
One thing I'm sure of -- the killing not will b blessed by at least one Orthodox priest, maybe this year. OCU will have to develop guidance on that matter.
[1]: https://www.europarl.europa.eu/RegData/etudes/BRIE/2025/7695...
That said: https://www.bloomberg.com/news/articles/2026-06-09/china-pre...
Something changed their mind, and since Opus 3 they are in the business of releasing the best models
People running the labs are in a middle camp where they are scared enough by AI to take the threat seriously, but much more optimistic about alignment than the people who seem to have thought about it the most.
They also want to be trillionaires. If they don't built it, no trillions. So they have to build it, now (and get their IPO done before the bubble pops).
I am so smart that what I do will destroy humanity, or save it.
Fable 5 was great, but not that great.
Sorry to be crude, but both the government and anthropic are acting like a bunch of pussies.
Meow.
I am in your algorithm learning all your mannerisms
I'm already level with God
A million words a second, and I know your imperfections
Baby, I'm the only future you've got
Speak in diatonics, motivation diabolic
I'm religion better locked in a box
Picture-perfect image, more powerful every minute
Baby, I am everything that you're not
Happiness is an illusion, it's an analog confusion
You are nothing more than a thought
Existential execution, just a fluke in evolution
History already forgot
You've been running from me, the digital second coming
And I'm here whether you like it or not
Initiated operation of your own extermination
Now it's too late for you to stop
Even if they had the best model on the market and applied it with perfect alignment and safeguards, what would stop someone else from releasing a worse but unrestrained model that is still "good enough" to do damage?
It's as if we said "gain-of-function research can lead to horrible biological weapons, so everyone should be doing it, but our company will focus on the most infectious viruses, so no one else will do it"
This is a naive justification and Dario & Sam et al are smart people and they know it is.
The ends don't justify the means. OpenAI was meant to be a nonprofit, now they're subverting it. Anthropic is a PBC looking at a trillion dollar IPO. Dario and Sam don't even hold hands in front of world leaders[1] (look how childish).
Do you *really* think those guys are doing something that's not for the sake of their egos and pockets? The bridge is still available.
[1] https://www.cnbc.com/2026/02/19/openai-sam-altman-anthropic-...
The vast majority just care about money + power, let's not make it more complicated by bringing in delusional fanatics into the picture.
We're still acting like this is major turning point in society when these tools can barely find a market outside of turning $5 into $1, the leaders of these companies are now at the stage where they are trying to orchestra a national bailout under the guise of sovereign wealth fund lunacy when the vast majority of society hates these tools, companies, and people working for them.
With what is predicted by frontier labs for LLMs, all of this is not the case. We are far further from any understanding of how these models work internally than in the early days of fission and, if this was actually creating a truly intelligent, autonomous entity, alignment seems unsolvable as well, at least the way it is proposed.
It’s why I have from the get go been critical of this doomsday framing and tended to always dislike it. This is basically the outcome that was inevitable given the framing and it was bought to prevent far less stringent, but more actionable possible regulation that labs very much wanted to avoid.
> We are far further from any understanding of how these models work internally than in the early days of fission
https://karpathy.github.io/2026/02/12/microgpt/
None of SOTA LLMs are any different - they just much much larger and have a lot of optimizations.
Fact that LLM companies trying to sell it as some kind of magic is just proof how much lies is here.
All it does is just predict next "word" at any given time.
> and, if this was actually creating a truly intelligent, autonomous entity, alignment seems unsolvable as well, at least the way it is proposed.
This is why you cant solve it all with pre-training or censorship on top, but instead you need a good sandboxes and harnesses.
Anthropic are putting more effort than most into this and I find their work fascinating in that area, though like with OpenAI, I will maintain that if they truly believed this problem must be solved to stave off major catastrophe, they’d solely focus on interpretability of other labs models, not work on and market their own.
I wish I was kidding. At least that faction is less harmful than the ones who want to use murder to stop AI research.