upvote
“To us” is pivotal there. Continuing GP’s thought experiment: what if the model that produced the output perceives that the human it was presented to offers no value in helping it learn further?
reply
May I counter, what purpose does such a machine have to us, that can think beyond our needs?

We can think of questions we can't answer. It can answer them.

reply
Maybe it can, maybe it cannot- comes down to the question.
reply