upvote
I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.

Bad thing can certainly happen. In fact it'll likely happen. Still, good things too, equally likely. In your words, "good AI" can be used to prevent "bad AI".

Nobody knows the extent of the impact. Who says otherwise is foolish.

reply
>I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.

The extinction of the dinosaurs. I mean yes, it allowed the growth of large mammals and us, which did a lot for science.

I just don't want to write the next chapter as "The extinction of humans allow the growth of the computing civilization that went to the stars". I mean I'm a bit attached to living.

>Nobody knows the extent of the impact. Who says otherwise is foolish.

We live in a universe of statistical probability. Creating an agentic intelligence that's smarter than you tips the probability of a major event to unity, who says otherwise is foolish.

reply
Because we humans haven't had a bad enough history event yet, like a global thermonuclear war. Or perhaps climate change reaching tipping points driving the temperature up past what global civilization can adapt to in time.
reply