upvote
but a human doesn't attempt to make up an answer, the human knows that he doesn't know?
reply
Yes, they have some alien failure modes. But that should be expect, they are an alien intelligence. I might be willing to grant that a lack of ability to reflect on its own level of knowledge is a demerit to it being generally intelligent. But then again it is largely an artifact of training. I suspect if there were a guessing penalty during pretraining they would develop or more readily communicate the strength/reliability of their knowledge.
reply
this is so false that Dunning and Kruger invented a name for it
reply