My framing may have been confusing there. “distillation of the very best human knowledge of expertise”. Distillation is different from outright capability or reliability. It is not directly adjacent.

For anything health related all AI models show high levels of anchoring bias. I would not use it as a confidant, and be skeptical of claims. Even so, human doctors are also fallible and prone to cognitive bias.

I think the obfuscation is because human intelligence has been projected onto AI model capability. AI models only have a limited dimension of human intelligence, and in some axes orthogonal, and when I say distillation I refer to this.