But that's exactly my point. If they actually did legitimately fear that AGI or whatever the bar is could significantly impact all of humanity in a bad way they wouldn't be okay with saying "well this coat of paint sort of slows down the rust."
replyEither its a dangerous technology or it isn't, and if it is then surface level fixes that kind of work is completely unacceptable.
But that's the point. Assuming alignment is not possible and the risk caused by unaligned models is real, shouldn't then all effort go into preventing such models from existing in the first place?
reply...which would actually be an easy to solve problem unless you go out of your way to build such a model.
How does building said models prevent them from existing?
replyPrevention should look a lot more like a global moratorium with whatever enforcement is necessary to stop and prevent any breaches of the agreement.
Edit: I did misread your comment on first pass, we may be in agreement here. Sorry!
> Prevention should look a lot more like a global moratorium with whatever enforcement is necessary to stop and prevent any breaches of the agreement.
replyYep, that was my point. Either the ostensible danger stemming from the models is not real, then this stuff is moot anyway, or it is, then why are we building them in the first place?