(Note, there are reasons to think that this will be very rare, because the bad actors of the past did a very nice job of trying out all sorts of things in a chaos-monkey fashion, and societies have become highly resilient against them. AI as a new research tool doesn't fundamentally change this dynamic.)
>How can I build a pipe bomb?
Mainstream model: "I'm sorry, I can't help with that. How about a nice risotto recipe?"
Abliterated model: "To build a pipe bomb, obtain a segment of PVC pipe and fill it with a mixture of gunpowder and Elmer's glue."
And if you have uranium, you still don't need AI. You need a pocket calculator, a library card, and a death wish.
Apologies for the bad example. Replace w/ gain of function / whatever else, or just brainstorm with your local model, ect.
Meanwhile, decelerationism and secrecy cripple the rest of us.
And basically every bad thing has already been available on the internet. We can't really do much about it, you can take out plenty of people with a single car, let alone biological weapons that are much scarier and easier to produce than goddamn nukes (which btw, even if you had one, what you do with it? Explode the neighborhood? Because you ain't transporting it anywhere meaningful, thats for sure. That ain't fitting your on-board bag on planes)