upvote
They aren't, but the problem is that open problems tend to emerge when people are working on other problems. If fewer people are spending time deeply thinking about current problems since a handful of labs are solving them with AI without an eye towards understanding and only on verification, the pool of open problems won't be continuously growing. There is a fear that there will be a chilling effect on the community if people are disincentivized from trying to solve deep problems or study them for understanding as opposed to simply focusing on verification. It's more of a social and community problem than a fundamental problem with mathematics itself becoming "completed".
reply
So we can let the ai generate some math problems based on the solutions found? Other fields (computer science, physics, ...) can generate math problems too.
reply
There's an infinite number of possible math problems, but the things that make these open problems worthwhile is they're interesting to people who have worked in related areas.

They're good to give to new mathematicians, and they're good to help humans understand the shape of the problem space and relative difficulty with the tools we have.

Cheesing these problems with LLMs gets rid of both the training benefit and our ability to create good related problems. There's an aesthetic part of this, too, that LLMs do not capture.

reply
This kinda reminds me of the guys who decided to industrialize digging up dinosaur fossils, in order to feed the dinosaur fossil collector market. They were amazed that paleontologists were so "inefficient" at finding and digging up dinosaur fossils.

But from paleontologists' perspective, they go out looking for dinosaur fossils when they have questions that digging up a fossil may answer. The metric they're focusing on isn't tons of fossil mined out of the ground, it's a developing understanding of extinct life.

reply
These open problem solutions often reveal tighter bounds on prior conjectures. Even if the solutions produced are far from elegant and only machine verifiable, we do learn new information. But I agree that just like writing prose and code, brainstorming frontier math proofs is a perishable skill
reply
That explains a lot on why his arguments always focus on the "social part"
reply
tl;dr - it's content creation rather than process and understanding
reply
deleted
reply
It's easy to come up with new open problems. It's hard to come up with new open problems that seem to teach us something fundamentally new about the world. Our current batch of problems went through a complex selection process over decades (or centuries) based not purely on difficulty but also on perceived insightfulness.

I studied math, but I am not a mathematician, so I think I have a slightly different perspective on this than Tao overall. This is certainly the definitive end of an era in mathematics, but I think he's wrong that insightful new open problems are truly non-renewable. They might be non-renewable by humans at the rate at which they are being closed, but I see no reason why AI systems could not also discover insightful new open problems. In fact, once we have Riemann-capable AI mathematicians, I'd personally love to see what the next Riemann hypothesis is, which even these AI systems cannot solve with any amount of available compute.

I think we're about to find that, on the spectrum of mathematical intelligence, the best human mathematicians were only a fraction of a percent forward from the very beginning, and there's a vast universe of mathematical depth that's beyond our ability to imagine or work on directly in any way. We're used to feeling like we're able to directly perceive the Platonic realm, but we're almost certainly going to discover that our own minds, even when joined together over centuries of deliberation, can only interact with a tiny little shadow within it.

reply
I haven’t been following the AI proof stuff very closely, but the impression I got was that these models are producing massive Lean programs that prove the statement one way or another, but are quite difficult to fully understand.

Actually, I have to admit I don’t really know what math is. With physics we suspect there’s a universe, and when we study physics we’re improving our description of the behavior of that universe, right? The universe exists whether or not we know how it works.

Eventually, as you suggest, maybe we’ll hit math that won’t fit in anybody’s head at all. What is the nature of mathematics that doesn’t fit in any human’s head? Does it even exist in some sense?

reply
I think math is compressible structure. That's why we care about something like the Riemann hypothesis but, to use Tao's example, we really couldn't care less about computing the 10^10^10th digit of pi. The first compresses a vast amount of information about the primes, while the second decompresses information that we've already compressed (a few lines of code can define every digit of pi).

Most patterns that exist are incompressible. Math is basically a search for those compressions that do exist. An example I personally really like is the amplituhedron: a geometric structure that humans have just barely been capable of recognizing compresses information about scattering amplitudes and Feynman diagrams. That one happens to be within our reach, but it's right at the edge, and we can only imagine what glorious, wondrous compressions exist in abundance beyond the edge. Math accessible only to superintelligence would exist entirely beyond that edge, compressing patterns whose existence we cannot even detect using objects and constructions that we cannot grasp.

As an aside, I also think this is why AI is quickly becoming superhuman at math: intelligence is essentially a form of pattern compression.

reply
I think part of mathematics is taking things that don't fit in our head and giving them human abstractions so they can.

Take infinity. Infinity can't fit in your head, hell, it can't fit anywhere, but you can abstract away the endlessness and look at infinities of different sizes, et al.

Now, is there a single formula for something actually represented in this world that would take most of a humans life just to read it, no idea.

reply
The models produce both Lean code for formal verification and a traditional-style narrative proof. Like the general long-form output of frontier models, the math papers produced appear to be generally correct technically, but written in an ungraceful and sometimes hard-to-follow style, so they are often polished by a human mathematician as of today.
reply
What you are saying implies that by some technique that hasn't been discovered yet, we can make the models to have the capabilities of extrapolate the information they are trained on and also interpret that what they are extrapolating are Riemann-capable hypothesis. I do believe it will accelerate the discovery of that "vast universe of mathematical depth that's beyond our ability" but at the cost of removing the "fun part" of solving the problems. Not sure if the community is willing to do that.
reply
I'm surprised nobody has stated the obvious: a hard math problem that has been open for ten years (because many serious people have given it serious thought and been unable to make significant progress) is, in fact, nonrenewable.

The only way to renew it is to make a new problem that is so hard systems and humans will be unable to solve it for the next ten years. And, in the spirit of trees, the best time to plant a tree is twenty years ago, the next best is today: we do need to start posing some hard math problems and deciding if they are interesting merely because there are challenging or because of something else (eg busy beaver problems are arbitrarily hard, but does solving them imply anything other than "another busy beaver problem was solved"?)

reply
Eh, if AI quickly solves most of our mathematics problems that are solvable then it might be time for us to hang up our hat as our little monkey brains aren't very good at this stuff.

Now, I think AI will solve some, but we'll find out that some are just either unsolvable or wildly huge that nothing is solving them any time soon.

And a whole lot of these problems have been around quite some time, when even knowing how to do advanced math meant you were a landed gentry or someone of high wealth. If those problems fall, they fall. They aren't pets we keep around forever. And new problems will crop up over time for both AI and men to scratch their brains over.

reply
I think "close to completion" is not the right framing. Creating good open problems was an achievement because these problems often sit at the edge of known techniques, and solutions require inventing "new math". It's hard to find these problems, and they take decades to mature as they withstand scrutiny by many people.

In another comment below, I likened this to clear-cutting a forest. Growing the forest takes a lifetime; destroying it could happen in the next few months.

reply
his whole point is that specifically problems that have been held as important by consensus in the field are a finite resource. obvious example being the Clay millennium prize problems. seems like they function to shape the direction of future research into useful directions. which is to say, the process of developing a solution itself generates more useful problems.

of course thrrr are tons of problems once you remove this social consensus based filter. if i’m not mistaken Ramanujan left a book of dozens of unproven theorems, for one quick example. i don’t think that that has opened up dozens of fields of mathematical research.

reply
> the Clay millennium prize problems

augmented Hilbert's problems of 1900.

Surely mathematicians are creative enough to ask new questions?

If not, then the next set of challenges will be to find questions to ask!

reply
Did you read Tao‘s tweets? That’s what he addresses
reply
Deforestation might be a better metaphor than mining. Logging is renewable if for each tree you chop down you plant several more. AI companies are operating "in a non-renewable fashion" by chopping down trees without planing seeds. Open problems are a renewable resource, but only if harvested sustainably.
reply
Relevant, interesting problems that we have some immediate hope of making genuine work on might be, if not finite, quite difficult to produce. And it's also plausible that AI will not do as good a job of producing these as it does at solving them.

The other problem that Tao identifies is that math has typically been an unusually open subject in many respects. This openness may not work if big AI labs can afford to throw $X million at a problem to scoop you if the rumor gets around that you think you have something promising. Hence, less collaboration, and less chance of identifying these exciting new problems, infinite though they may be.

reply
> I didn't realize that open math problems were a finite resource.

That is exactly what Tao is explaining in that tweet.

TLDR: Open Problems are infinite, but those which are at the boundary of easy and hard problems and are interesting are far more scarce

reply
He addresses your point in the first paragraph.
reply
> I didn't realize that open math problems were a finite resource.

There's an interesting commentary about this: https://mathstodon.xyz/@tao/117237320796901560

> famous mathematician (Gauss?) dismissing interest in Fermat's Last Theorem claiming that he could crank out problems of equivalent interest.

Web search turns up Gauss's comment, with a bit more nuance: "I confess that Fermat's Theorem as an isolated proposition has very little interest for me, because I could easily lay down a multitude of such propositions, which one could neither prove nor dispose of." (https://mathshistory.st-andrews.ac.uk/Biographies/Gauss/quot...)

reply
You can indeed generate many nonsensical problems. Generating ones which require interesting and non-trivial mathematics is much more difficult.
reply
I think you can't have read the thread. The whole point is that there is no end of mathematics, an infinite sea; but the constitution of an 'open math problem' is a delicate piece of mathematical thought, at any moment a small supply of drinking water developed by finitely many human being.
reply