upvote
> They're legally culpable for the consequences of the machine they made.

Ah, I love this argument. In my country cars are legally required to stop at a pedestrian crossing if there are people beside it. Some people use that as an argument as to why they can just walk out into the crossing without even looking at the traffic. "It's the driver's fault! They are legally culpable!" True, but you'll also be dead.

reply
And that driver will be punished and no longer driving
reply
I'm not going to say you're victim-blaming, but I will say that there are degrees of difference between "looking both ways before crossing the street" and "hardening my website against unforeseen attacks by rogue AI agents."

AI black-hatting your website is not the same sort of foreseeable consequence that crossing the street without looking is.

reply
> it gets out, and a global pandemic ensues

I mean, yea, you should be punished. The problem is there is no amount of punishment that I can put on you that can even get anywhere close to the amount of damage you cased.

Worse, the rate of technological growth is putting the capabilities to engineer viruses in the hands of people that may otherwise be suicidal. You can't punish them after they already won (in the sense of reaching their goals).

While, yes, OAI should absolutely be punished, the future is majorly screwed as our power scaling laws are increasing much faster than our ability not to be stupid.

reply
> The problem is there is no amount of punishment that I can put on you that can even get anywhere close to the amount of damage you cased.

Sounds like your corporation should be dismantled then. But doing more than a fine in the millions is obviously not possible

reply