undefined

points

[-]

The particular problem here is quantified the inherent danger of a technology. That is, once you remove the active management of humans, what dangers can happen.

With dangerous chemicals and radioactive materials these are generally pretty easy to classify. This said, after the physical behaviors, the above technologies can induce behavior changes in humans because they exist. After nukes, a lot more people had issues with extental dread. It also causes n-order interactions that get very hard to predict. For example MAD or laws against using chemical weapons.

And these are weapons with a very easy to map out causal chain in their own behavior. You can't prompt a chemical weapon to make a decision.

We come up with agentic AI and all of a sudden a lot of rules on causality break. In a harness they are a causal agent. They can interact with a digital reality, and with the right tools and/or human contacts they can causally effect analog reality.

Anyone that says 'programmed' about an LLM almost certainly does not know what they are talking about and can be summarily ignored.

by fastball2 hours ago|

prev|

[-]

How is that comforting? Humans pose almost infinite danger to themselves. We can (and have) done pretty much everything you can do. We've had the capability to glass the entire earth for 70 years. We've had bioweapons, chemical weapons, mass murder, you name it.

Accelerating the ability for any given person to have access to some amount of these capabilities is terrifying, is it not?

by pixl972 hours ago|

parent|

[-]

I'm getting so many replies like the one above yours recently. It's like the average person has not really incorporated the fact that we've made something different than all other things we made before now, we'll, except maybe babies. It is comforting and easy to think this AI technology is the same as everything before therefore I don't have to do anything and the problem will solve itself as other problems did in the past.

Maybe many were too young for the cold war. But it really does feel like we're setting a new one up.