A dismal prospect.
When knowledge is acquired at a human scale, and under the influence of a human culture, then extraordinary things can happen. Agriculture, the transistor, Gödel's theorems.
When knowledge is "churned out" at "factory scale" then human flourishing isn't even a by-product.
Actually, this is the fundamental divide. There are a group of people (like you) who want the world to be one way, and there are a group of people (like me) who think that world is abhorrent. I don't think we should go after that power.
But, I'm glad we got to this point in the discussion because it shows this irreconcilable divide. The truth that most people will never say is that these two groups are enemies and will forever be. They fit into this world because we currently participate in the same global system, but because of this situation, it's an unstable one. And AI is exactly the system that is distilling this antagonism to its limit.