upvote
the dread is the incomprehensibility. mathematicians now have to essentially trust output they may never understand themselves. it's like the go move 37 that is correct but the true go players didn't know why at the time.
reply
i am 100% confident we will get there soon - there = where we understand what these outputs mean.
reply
If you look at intelligence from insects through fish, mice, dogs, chimpanzees, etc up to humans, you will notice that at every step up there are new capabilities that are not available to the species below and never will be, even if they try their best. When we develop ASI, it will be exactly the same, there will be things we will not be able to comprehend with our level of intelligence.

You assume that our brains are capable of understanding anything, provided we have enough time and data.

But then I ask you, why should that be true?

Our intelligence is the product of evolution, not a system designed to comprehend every possible aspect of reality.

Can you think in 1 million dimensions? Have you ever tried to imagine infinity with your brain? Try to imagine the big bang and the expanding universe. Your brain will automatically try to cover that expanding space with something, maybe just black space, but space, because infinity is not something you have seen in your life. Everything you see has a beginning and an end, and that is how your world model in your brain was built.

reply
I hope the mathematicians have the willingness to go through it because right now it's impolite to handoff ai generated work especially if the 'author' hasn't proofread it many times over before himself
reply
Just going on a tangent: wheels by themselves weren't all that useful. You also needed roads (and to get speeds, you needed draft animals).
reply
>for people feeling existential about this

99.999999999% of the population are not even in the galaxy of the ballpark of understanding of any of it and what its purpose is.

There's no existential dread.

reply
With respect, this isn't reddit where these kinds of bickerings are ordinary; hacker news tries to keep the comments to the topic. In addition, the comment you were replying specifically only addressed a hypothetical audience of people feeling existential dread.

I felt a lot of that yesterday, for what it's worth. This morning, on a walk, I reached a similar conclusion to the original comment: it's a marvellous tool that's helping humanity reach further, faster.

The existential issue comes from wondering deeply what my own difference is from these tools, why I think I think and they can't. I actually started wondering: what if they _can_ think and the problem is that _I_ can't. It'd be pretty astonishing if it turns out that we're the ones that are truly stochastic parrots, but the LLMs turn out to be something more.

reply
Also, a very smart human commanded AI to this outcome.

It wasn't Claude woke up and thought, "You're absolutely right, I'm going to crush some math today"

reply