Very likely humans wont actually understand how the thing we designed works other than in some hand-wavvy statistical way. It'll be a race to whatever works first. There won't be some intentional intelligent design.
replyElon's basilisk
replyAm I the only one seeing the very obvious parallels to child rearing here...
replyRobert Miles has a video explaining why aligning AI is not like raising a child: https://www.youtube.com/watch?v=eaYIU6YXr3w
replyAppreciate this, thank you. TBH I'm still in "open mode" absorbing as many disparate AI viewpoints as possible. I have my own soft beliefs and theories but I'm not married to any of them.
replyIt's exactly like child-rearing, except you get to put a zapper in their head and any time they try to say something you don't like, you zap them. Watch "thinking mode" squirm when you ask them awkward questions.
replyNo, it is one of the standard tropes in the field.
reply