upvote
If something were intelligible to adults but not to children would that make it not knowledge?

That’s a separate question with its own term: common knowledge. I am willing to set a much lower bar: something is known to humanity if it’s known by at least one human.

Personally, I don’t believe that AIs know anything, as they’ve been constructed thus far. Knowledge is justified true belief, and AIs don’t have beliefs, they only have utterances.

Why do I think AIs don’t have beliefs? Because they contradict themselves all the time.

But it really doesn’t matter if you think AIs have knowledge or not. If they cannot explain it to us then it’s inaccessible to us, so it’s a “tree falls in the forest with no one around” situation.

reply
If I see a red apple, then I know the apple is red regardless of if I know exactly how the physics of light work. Those are two different pieces of knowledge.

If it's formally verified and we assume the kernel is good and problem definition properly vetted, then I know the GRH is true regardless of if I know why it is. Because those too are different pieces of knowledge.

reply
If it were intelligible to LLMs they could explain it in human terms, but they can’t.

There is no explanation here, there is a GB of Lean code and it’s not like it all fits in the context at once.

reply
Someone else has posted a Gemini-compiled 43 page human-readable explanation elsewhere. It very quickly exceeded my own math abilities, unfortunately.
reply
Why do you think they can't explain it? Try asking them questions, they will explain it.
reply