upvote
> Several hours of work with Fable simply convinced me it wasn't yet solvable and reinforced how hard of a problem it was.

This is the part that gives me the strangest feeling about it all, because you're not the only one with this experience. I've experienced this too on different problems, as have many researchers across many fields.

I disagree with the Fields Medalists on the majority of their complaints. AI math is happening and there's no going back. However, on one point I increasingly agree: virtually none of this stuff is possible with technology any normal citizen has access to. I have no problem with AI models making revolutionary advances in math or science. Where I start to have a problem is when the AI models making these advances are tightly withheld, proprietary, and seemingly never released with these capabilities intact. This has been the case for all of 2026 so far.

I suspect that this is in fact the source of much of the angst. None of this progress is reproducible outside of one or two teams inside OpenAI and Anthropic. It's becoming an incredible concentration of power that I don't know that we've ever quite seen before. Right now, it feels harmless because it's being used for wonky math problems that aren't (yet) practical for anything. But great power never stays harmless. History has taught us that countless times, in countless different forms.

reply
> I suspect that this is in fact the source of much of the angst.

Why do you "suspect" this as if it's some hidden motivation when the very first paragraph of the advisory group's statement (linked from the OpenAI post) says:

> At present, some frontier AI labs are testing advanced mathematical problems on proprietary models that remain inaccessible to the broader scientific community. Our recommendations are formulated with this practical context in mind. However, ideally, they would not do so. We want to state clearly from the start: we do not endorse this practice, and we ask them to stop testing advanced mathematical problems on proprietary models.

Tao and others in that group have been strongly and publicly pro AI from the start. They are not advocating "going back". They're objecting to the strip mining of open problems using proprietary technology.

reply
OpenAI: At long last, we have created the Open Problem Strip Miner from classic Terence Tao tweet “Don't Create The Open Problem Strip Miner”.
reply
I don't think the strip mining metaphor is appropriate. Mining is a zero-sum game; if I mine something, nobody else can go and mine the same resources I did. Mathematical problems don't go away when AI finds a Lean proof. They create new opportunities for humans to study the solutions, learn new techniques from them, identify promising directions for future research, discover alternative/more beautiful proofs, and write expositions for other humans.
reply
Strip mining is very apt if you view the economics of the present system as "effort -> recognition -> career advancement". Even in strip mining, the resources that had been buried are now available for use in the broader economy. What's no longer available is the living that was to be had digging them out.
reply
The problem isn't effort, though. All of the things I mentioned constitute effort and could be rewarded. The job economy was created by mathematicians incentivizing the proof of difficult theorems above all else and valuing all other work at approximately zero as far as career advancement was concerned. Now they're pulling a 180 and claiming that math was never really about proving theorems, but that's contradicted by their revealed preferences. The strip-mining problem only exists if they continue with the status quo ante.
reply
Mathematicians aren't homogeneous. There are mathematicians valuing pedagogy, collaboration, bridge-building, theory building, along with those that chase the 'difficult theorems', to name a few, and there are lots of flavors within each class, with lots of blending and blurring. You infer that mathematicians prefer the status quo simply because it is the status quo -- with a little thought, you'll recognize that this is a fairly silly notion.

There are myriad circumstances where the values of most practitioners differ from the status quo, which is nevertheless well-entrenched. This can arise from inertia, or from outside forces, such as broader cultural milieu, integration with larger institutions, or contending with economic realities. If you think that these do not and haven't historically played a role in determining the job economy and that math is a pure field where mathematicians could comfortably shape it according solely to their own ideals then you are naive

reply
And, in addition, many mathematicians are graduate students or postdocs hoping to line up a permanent job soon.

For example, if you look at Terry Tao's blog, he has a tremendous amount of first-class expository writing. So, too (to some extent) do junior mathematicians -- but, unfortunately, this tends to not be highly valued by the job market. Grad students and postdocs have learned that to succeed they need to play by the existing rules of the game.

Well, the board has just been yanked from underneath them. People like me can afford the sort of idealism and soul-searching that the parent comment describes, but junior mathematicians face a very unenviable set of circumstances.

reply
1) I never said the problem was effort; I was trying to explain the strip mining analogy, and it's one of the two anchors that make the analogy work.

2) Mathematicians didn't create this economy; it was foisted upon them by the same managerial mentality that brought us "publish or perish" and "the monthly sales quota".

3) I can't tell if you honestly don't get why the strip-mining analogy resonates, or...?

Here's another analogy: if we suddenly discovered personal teleportation, and marathon runners were complaining that it was ruining the sport, would you say "they're pulling a 180 and claiming that marathon running was never really about getting to a point 26 miles away as fast as possible, but that's contradicted by their revealed preferences"?

The strip mining analogy is better though, because it captures the sense of irreversible goal-loss when a problem goes from being "unsolved" to "solved".

reply
As far as I understand, even with "publish or perish", peer reviewers decide what counts as an important enough paper to be published in a prestigous journal, and committees of peers decide whether or not, say, an expository article on arXiv or a textbook counts toward hiring or tenure. Again, as far as I understand, those things have largely not been rewarded in the past.

I like your marathon example, but maybe not for the reasons you intended. The community of marathoners decides the rules of a marathon. You don't need a hypothetical teleporter; you're already not allowed to use a bicycle, performance-enhancing drugs, or shoes that don't fit the specifications. The rules are updated to adapt to changing technology. Yes, I'm arguing that the strip-mining analogy doesn't make sense because mathematics is in the same situation. There's nothing stopping peer reviewers and hiring/tenure committees from changing the rules about which kinds of effort confer recognition and career advancement.

reply
Strip mining is an extraordinarily appropriate metaphor.

Imagine a mine has an unknown number of rare materials. And you know the general location of a few of the most valuable spots. But you don't know what may be valuable right next to it. If the pieces that we know are valuable are suddenly gone, the incentive to mine that particular area drops considerably, dropping the chance to discover potentially brand new materials that would have been found the normal way.

reply
That's an empirical claim. I could equally well say that doing an automated search of the problem space and having a database of results and open problems will identify vastly more interesting and valuable areas. Again, the idea that math is some exhaustible material is a metaphor, not an established fact. I'm willing to change my view as new evidence comes in, but I think we're going to have to wait and see what the landscape looks like in a few years.
reply
> the incentive to mine that particular area drops considerably, dropping the chance to discover potentially brand new materials that would have been found the normal way.

FWIW, I think the metaphor breaks down with this framing. This isn't really a problem associated with strip mining, what's left behind is generally low or negative value (toxic). I'd suggest a different metaphor, from Wikipedia:

> This process involves the removal of all ground vegetation in the area, which is a detriment to the environment.[19] Topsoil may be placed over the tailing along with planting trees and other vegetation. Another reclamation method involves filling in the hole with water to create an artificial lake. Large tailing piles left behind may contain heavy metals which can leach out acids such as lead and copper and enter into water systems.

This feels very similar to the issues with algorithmic problem "mining". It has the potential to destroy the human ecosystems surrounding these problems, leaving barren wasteland behind where nothing can grow or flourish.

reply
I hope sincerely hope they don't currently use "proprietary technology" like:

Wolfram Mathematica ($890/yr)

Magma ($2500/yr)

Maple ($680/yr)

COMSOL ($1500,yr)

Matlab ($500+/yr)

Seems like a very strange position to take, in my opinion.

Why does the field of mathematics suddenly now need to be "fair" and give everyone access to the same tools? Has that ever been the case in academics? It's always been a competition for name-recognition, grants, institutions, etc.

Macsyma / Maxima was an MIT developed CAS system back in the 60's that was proprietery until they sold it off to IBM for a tidy sum. Magma actually has free access if you're in the US, otherwise you pay. That's not to mention proprietary MATLAB toolboxes or specialized Stata modules.

Likewise, a lot of the above packages have pretty sweet site-wide deals with R1 universities. If you're at a smaller, foreign one, you're out of luck.

reply
I was looking at those costs think wow, that is high.

Then I realized I was spending 3600.00 USD for Anthropic and OpenAI per year.

reply
> Tao and others in that group have been strongly and publicly pro AI from the start

Unfortunately being "pro AI" means relinquishing any control over what the AI, or more importantly the company running it, might be doing.

reply
How is this different from literally any other part of the economy?

We've relinquished control over just about everything we use or consume. We can't compete with larger enterprises for production of food, clothing, machinery, medicine, energy, services. Mathematics is just the latest thing to be industrialized.

What keeps large companies under control is competition with other large companies. This competition causes the surplus value they produce to flow to consumers, not be hoarded via monopoly prices. Do we see strong moats that are going to cause monopoly in AI? I don't see it, and in particular I don't see it persisting if it exists transiently.

reply
You're right, and that's a bad thing. AI is nothing fundamentally new, but its extremity is making many people aware of the truth that's been there all along. There's no contradiction in that.

> Do we see strong moats that are going to cause monopoly in AI?

Ownership of the capital assets used to train and inference new models. Yes, we may end up with more than one firm. But as we see with big tech today, a small number of fantastically wealthy firms in "competition" does not an open market make.

reply
Is it a bad thing? We live in a society. We depend on the work of other people. We are not autonomous. Sure, we can try to be self-sufficient, and that would lead to a subsistence lifestyle much degraded compared to what we experience.

Somehow you have to argue either that society itself is bad, or that math is somehow different from all these other human activities.

I think the obvious fact that people prefer to live in places with large commercial organizations shows they don't really care about that, at least to the point of foregoing the benefits these organizations bring.

reply
No, it doesn’t. You can be in favor of something and opposed to a particular way of handling or implementing the thing. And the issue here isn’t what it’s being used for but who is able to use it.
reply
The company running it should be you. The future of AI is open and local.
reply
"AI" is largely a marketing term for a particular type of computer program that uses a statistical language model.

Computers and computer programs are tools. Humans always remain sovereign over their tools.

reply
And incentives are sovereign over the humans. The humans leading the AI labs have every incentive in the world to move quickly without any restraint.
reply
The second law of thermodynamics always wins.
reply
Eventually. In the meantime, here in the human socioeconomic sphere, you might be dealing primarily with the Second Rule of Fight Club and Operation Mayhem.
reply
I am not sure how convinced I am by that argument. A gun is also a particular kind of tool, and it makes the person at the handle end sovereign, and the person at the pointy-shooty end subjugated.
reply
Regarding the advisory group, OpenAI claims to “have drawn on their advice”, which would include not dumping a bunch of AI slop, with the footnote that if they do do that, at least fund the process of digesting it.

At the same time, there's a new note at the bottom of agmai.org stating how they've been in contact with OpenAI about this particular release, and they say that “we consider these discussions constructive, it is ultimately up to the mathematical community to assess the extent to which our recommendations were followed successfully”.

So, what's going on there; is this British English for “they didn't follow anything at all”? Because from my perspective, it looks like they doubled down on the Navier–Stokes approach of trying to maximize PR gain while being as lazy as possible about actually contributing anything back to science, releasing only slop that may or may not be correct and may or may not be straight up plagiarism, as has been the case earlier.

If I were on the AGMAI board, I'd feel terribly exploited when reading that press release, yet their response is modest.

Hairer, if you're reading this: is there any indication whatsoever that AGMAI was anything but a cheap way for OpenAI to science-wash their press release?

reply
> is this British English for “they didn't follow anything at all”?

Yes, but the subtext is even stronger.

reply
> AI slop,

Now I know there are issues with the field and how just answering these questions may cause broader problems, but I feel like the posted results is far from slop. We can't just call any output slop, or it loses all meaning.

If it was slop, it'd not be causing the issues the group are concerned about - they're not saying "the problem is we're getting loads of incorrect proofs thrown about that are nonsense".

reply
When you blanket a set of things with a pejorative, and it turns out that some of the members of that set are demonstrably and definitively NOT covered by that pejorative, and that all the pejorative means at bottom is "I don't like", all you've accomplished in the long run is to call into question any future legitimate use of that pejorative. It is tempting, especially when heated, to stretch an invective, but it will ironically only lead to the death of its utility over time.
reply
So the fact that the Library of Babel (i.e. all possible books) contains occasional gems means that you can't object to using it on principle? That would seem to follow from your logic.

What about a filtered set "all well formed books"? Or "all well formed books that are plausible enough that they could convince a reasonable person, regardless of their accuracy"?

It's generally taken that a cup of sewage in a barrel of wine makes a barrel of sewage. Surely a reasonable person could claim that a barrel of sewage was still sewage, even if it contained several cups of wine?

reply
I personally just find it hilarious how the complaints and excuses against AI have slowly marched and changed from 2023 to now.
reply
They're not calling any output slop, they're calling indecipherable output slop. The management class responsible for hiring, firing, and paying people doesn't possess the domain knowledge to say for certain whether or not LLM output is optimal (which, in this context, means correct), but they will trust that it's good enough to justify further automation / fewer grant approvals / etc. So in that sense, slop can and will cause the economic issues people are concerned about.

University boards want the prestige of successful research programs. Doing the hard work to get something demonstrably true is going to lose out economically in this paradigm, where we are all being conditioned to uncritically ooh and aah at the incantations being elicited from these magic boxes. The oracles even have legions of zealots who will berate you for not being sufficiently deferential and reverent, or worse, accuse you of blasphemy. If for no other reason, I agree with using the term to express all of the above succinctly, even if LLMs can be helpful tools generally.

reply
I've read some of the results papers (the Einstein condensate one and the pi exponential one). I'm not an expert but it definitely wasn't AI slop. The introduction sections were particularly well framed and informative.

Also you can see in the papers where an idea is introduced but in the bibliography you can see where the foundational idea comes from. So the narratives are not unmotivated as some claim (proof without intuition claims).

reply
In the context of maths papers, the term has come to refer to papers having the shortcomings that are, for whatever reason, typical of LLM out, including things like using non-standard terminology all over the place, emphasizing easy steps while leaping over harder ones, having bizarre organisation, and, importantly, failing to properly cover existing work and as a result being hard to tell from plagiarism.

The degree to which these issues feature will differ, but it is generally the case that converting the output to proper research requires significant effort, hence the AGMAI recommendations being what they are, and not performing that effort tends to come off as laziness or incompetence, so I can see how slop has become the popular term.

reply
> We can't just call any output slop, or it loses all meaning.

The term “ai slop” is not supposed to discriminate good ai output from bad, the entire purpose of the phrase is a blanket term that delegitimizes all ai output.

reply
That is not how it is generally being used.
reply
That is exactly how I see it generally being used. Why else would people be dismissing work as AI slop without even reading it, discovering what it says, or even looking into how and to what extent AI was used in a project? Saying things like "if you didn't write it I won't read it" at the first whiff of an AI smell is absolutely said to delegitimize all ai output.

Or in this specific case, why would someone call these proofs (no one is saying they are wrong) AI slop if not to delegitimize all AI output?

reply
This. There's a large subset of people who, seemingly consciously, try to delegitimize anything related to AI by calling it* "slop".

* even pretty amazing advances like this one

reply
AI Derangement Syndrome
reply
People call some work AI slop "without even reading it" when the intention/substance of the work might exist somewhere buried within a wall of impenetrable LLM text (aka "the slop").

Good AI output is indistinguishable from human output. The whiff you mention is the reasoning pleonasm and tautology (intended) escaping into the output and the "author" not proof-reading/editing it out.

reply
But it also happens in many other contexts where that is not true, such as this one right now. Bringing me back to my point that it’s not to discriminate and clarify between good and bad, but to muddy the water.
reply
We can't argue the latter without quantifying the former. All terms are misused by someone, but if it's statistically insignificant that's not an issue. I'm not convinced this one is sufficiently misused to detract from the common definition.
reply
> The term “ai slop” is not supposed to discriminate good ai output from bad, the entire purpose of the phrase is a blanket term that delegitimizes all ai output.

Then it's a useless term and we should all stop using it.

reply
Haven't been following this debate closely, but what's the issue with "strip mining open problems"? Surely the supply of interesting mathematical problems is (in theory) infinite?
reply
You can find Tao’s arguments here: https://mathstodon.xyz/@tao/117237320796901560

He argues that the supply nay be very large indeed but the interesting subset is not. Figuring out the interesting problems is difficult so strip mining the good known problems may lead to scarcity. I am not a mathematician myself, can not judge this accurately.

reply
A Swedish proverb says, "a fool may ask more than ten wise may answer". This fool is reporting for duty! I'm glad I may have something to contribute after all (and I'm only halfway joking)
reply
i'd be curious to hear why he thinks ai couldn't help make it easier to discover interesting problems, ie to make the interesting subset less scarce.
reply
I guess you can see this as an exploration problem, in pure maths, while the goal is to solve a conjecture, the limitation of humans on pure computational power led to the exploration of alternative paths. Sometimes, these paths weren't leading to solving the initial conjecture but opened new idea and new direction. Sometimes a less direct but more humanly natural path was taken to solve the conjecture which also led to new and humanly understandable questions. In some ways solving the question wasn't the most important part of the work, as this doesn't have direct impact on our life (as I saw people comparing this with drug discovery), but the path leading to the solution raised new conjectures and techniques that further developed the field.

I have a really hard time reading AI proof so this might be a biased statement, but most of them feels like having a superpowerfull machine, that would have bruteforce all the possible words of finite length in your logical syntax. You have the path to the solution, using tools that where already known and even direction that where abandoned because they seemed to fail for our human brain. But at the end, as a mathematician, you don't learn anything that is really new.

To me this is the main risk with AI and in general the one most mathematican try to explain but fail, we might miss a lot of alternative path that would have raised more interesting questions (I think this is already more or less what is happening). On top of that, we will run out of mathematicians as no one wants to pursue a career in the field anymore.

reply
This relies on the idea that AIs will only ever do the thing they just did, and nothing more.

It's the same argument which is invariably wrong yet comes up over and over again.

There's no real reason to think AIs solving lots of problems will stop further work on alternative paths - certainly a machine which never tires and can be trained on its own solutions is going to continue to improve.

There's precedent for this: just look at any overconfident post regarding what China will clearly never be able to do, despite decades of steady if frequently flawed progress.

There's no persuasive argument being presented as to why machine mathematical research should have a limit beyond hardware capabilities.

reply
I think you are missing the points of my argument, my argument don't stand on AI isn't capable of discovering new techniques, as I don't believe in new techniques from the sky. My argument is about any targeted goal based AI (which to the best of my knowledge is the case for LLMs as used now). My point is, if there exists a computationally bounded path from existing work that led to solving a conjecture and if the goal of the AI is to solve this conjecture, then alternative path that would have led to new discovery will be dismissed on the way (or lost in the computational trace if you prefer), leading to the conjecture being solved but maybe closing forever/for a long time new paths. I don't see how you could have as a goal to explore alternative path without a good metric of what is a good alternative path (like rating a chess position), which to me, seems unlikely to exist. If you don't have such metric then you would have a clear exponential blowup. More like a percolation problem if you prefer, a neglected approach might have introduced a concept that would make further discoveries accessible. Missing that concept could therefore leave a whole region unexplored, not just one branch of one proof.
reply
The most immediate answer is because the models are proprietary and only available to those who want to hype the big labs.
reply
We can speculate on whether it can’t, but its plain to see that so far it hasn’t.
reply
Given how new it is, it seems premature to draw any conclusions from that.

If a human had solved these problems, we'd expect it to take years for people to digest them and formulate significant new advances.

reply
Given the demonstrated rate of improvement of AI in math this year, I don't understand the value of that latter observation.
reply
That’s what we are doing with nature, seas (look up strip mining there, it’s a horrible practice), and now the industrial harvestors are strip mining problem spaces. How do we like our own medicine?
reply
Developing solutions to mathematical problems generally leads to improvements in quality and quantity of life at roughly the speed they percolate from the ivory tower down to the shop floor. So "how do we like it" is probably going to be "we like it a lot, this is awesome".

Every company is about to have a staff Ops Researcher who has a better grasp of the underlying math and theory than any university professor. That is an unambiguous win.

reply
I see no reason why every company would have a staff ops researcher, or why such a position would have a better grasp of underlying math beyond the narrow slice that directly benefits the company. Why do you think that would happen?
reply
> virtually none of this stuff is possible with technology any normal citizen has access to.

Not sure about the unambiguous win. Are we entering the age in which mathematics is industry-dominated?

1) Any university professor can spend their 24 years on a problem with little progress. 2) company has sudden interests. 3) industrial resources brute force the Lean proof. 4) Max PR for AI company 5) professors are left to rewrite the AI Lean slop into real human-readable math? {disclaimer non-math university professor}

reply
No one is going to get tenure by spending 24 years on a problem with no results. The profs who have that much free time on their hands are already in the later stages of their careers with records of impactful results. By that time, a problem like that is more of a curiosity than sometimes expected to have broad concrete impact.
reply
I'm no mathematician, but (1) seems like a bad situation to be in. I can't speak to the practical usefulness of potential mathematical solutions like proposed here, but it seems useless to have an individual professionally spend 24 years on a single problem only to make little progress and eventually retire so the next person can stare at it.
reply
That's how most other fields progressed most of the time, isn't it?
reply
>> virtually none of this stuff is possible with technology any normal citizen has access to.

Initially, yes. Long term, however? Perhaps still yes.

> 5) professors are left to rewrite the AI Lean slop into real human-readable math?

6) AI writes the proof into something easier to follow than a PDF document.

Hmm. Oh shit.

reply
Who is "we" in that sentence? Why are you not speaking for yourself?
reply
AI math: "We believe this resolves all remaining questions on this topic. No further research is needed." https://xkcd.com/2268/
reply
"Further research is needed to fully understand how we did such a good job."
reply
deleted
reply
These are a specific set of interesting, compelling, human-sized problems curated to motivate clever people to engage with math.
reply
deleted
reply
> stop testing advanced mathematical problems on proprietary models

I don't know but this phrasing comes off as gatekeeping.

reply
It’s not. Intent matters.

Imagine there's a very advanced crossword club where anybody can join and take a stab at these crosswords for the love of solving puzzles. Many of them are so difficult that no one's been able to solve them yet, but we know they're all solvable.

One day, someone comes along with a super advanced crossword solver application, and it makes easy work of these crosswords. They run it on a few to prove how powerful it is, and then the community says, "Oh wow, that's cool, but please don't run it on any more of our advanced crosswords because they're very hard for us to come up with, and we really enjoy solving them by hand."

That's really what this compares to. I wouldn't call that gatekeeping; just respect. Respect for the game, respect for people's desire to have these hard problems to continue to work on, solving by hand.

If the company with the super advanced crossword solver then continues to use it and publish the results, they're effectively stealing the crosswords from this community. Soon, all the puzzles will be solved, leaving nothing left for the community to work on for fun.

That doesn't sound like gatekeeping to me. That just sounds like someone asking "Please be respectful and leave the remaining puzzles for us to solve by hand.” A simple plea not to be an asshole.

reply
We don't give mathematicians research positions to solve crosswords for fun. We want something back. We want theories and results that will advance our civilization.
reply
We have people who want to fill those positions because there are enough people who find it rewarding enough. Take away reasons why they would find it rewarding and you will have fewer theories and results that will advance our civilisation.

And yes, fun counts. Nobody said this had to be only a hardship.

reply
Money doesn't work that way though. There are plenty of jobs people would like to get paid to do, that doesn't mean someone needs to psy them to do it.

I'm well aware that if at some point AI is good enough to replace me as a software engineer then I won't have a job. I don't expect a company to continue to pay me simply because I enjoy it if there are cheaper options out there.

Math is no different.

reply
As long as that company doesn't expect me to continue in their employment if I stop enjoying it, then we understand each other.

Total compensation includes fun.

reply
This is really the critical thing: the fun is the incentive. (Or at least the dominant incentive in math, historically.) As economists like to say, the overarching lesson in economics is that incentives matter. Reduce the incentives and participation will decrease.

Perhaps that won't matter if we enter an era where AI participants are the main participants who matter for discovery-level mathematics. But it would likely be what economists would see as a market failure if only a small oligopoly of AI participants, closely held behind closed doors, is able to fill that intellectual role.

reply
I think you are missing the point of the main criticism. It is not about not wanting results in terms of proofs.

New theories and insights are typically created while working out proofs. If proofs now suddenly fall out of the sky (cause LLMs create them) then that work is not done which means the substrate on which new theories and questions and conjectures used to be grown disappears. It's in that sense that the math community (and thereby society as a whole) will lose something.

It's similar to how software engineering will need to find a solution to train their next generation. Current generations have all been through manual steps of designing things from scratch and writing them by hand. That's what allows your 10x engineers to understand whether what their LLM tools are doing is good and how to massage those tools to do the right thing. A junior engineer who has only ever used LLMs to write code and create architectures does not just not have that experience but also won't acquire it. You can't just say "we don't pay them to have fun and learn, we pay them to produce results". In the short term that is the case, but in the long term you as a company and we as a community will lose out.

I'm not saying don't use AI tooling. I'm saying that this is a hard problem which we yet to have to find solutions and approaches to. As a software community as well as as society in general.

reply
"A junior engineer who has only ever used LLMs to write code and create architectures does not just not have that experience but also won't acquire it."

My ego tends to agree, that how can they be ever competent, if they have not endured the same hardships as I had crunching trough problems and getting allmost lost in the details.

But I rather suspect, they will turn out fine. I know LLMs are great for me to learn and I think the young generation will learn what they need to learn to get the job done.

reply
How can they learn hard things if they have an infinite number of easy things to do? This is a middlebrow version of doomscrolling disease.

Most people have trouble not peeking at the answers. Look at Stack Exchange's long success.

reply
Because keeping all the easy things coordinated and understanding the big picture is still a hard task yet unsolved by LLM's? But yeah, who knows what happens once that change. I assume even after the singularity, it still makes sense, that we train some people to know what is going on ..
reply
How well do you think someone will understand fractions or trigonometry if they always punch their math homework into Wolfram alpha?

The increasing pervasiveness of technology in US education has not produced more capable graduates.

reply
If a modern Gauss, Von Neumann, and Ramanujan appeared and started dropping proofs from the sky, would people be saying the same things? And if they could live forever, so they wouldn't need to train their replacements?
reply
Who cares about them? I want Tao to stop proving all the interesting problems I was planning to work on.
reply
Gauss and Euler, and also Ramanujan (results without proofs, which is a bit like unreadable Lean) did that for their lifetimes.
reply
Yes, and they are revered as geniuses, which makes it clear that this is all sour grapes. And surely if people died, went to heaven, and were able to talk with God whenever they wanted, they wouldn't be upset that now they could know the answer to any mystery whenever they'd like; they'd appreciate that now they have someone to guide them! Or were they similarly upset when lecturers handed them already completed theory in school? There's already enough developed theory that people don't have the time to learn it all as it is.
reply
Not exactly, because we would have cool people to inspire us and hang out with us.

But your argument is nonsensical because even if Gauss and von Neumann appeared, they wouldn't go into random fields and just prove things mechanically. They'd have to attend seminars, teach others, collaborate with others, and generally inspire others with their brilliance. It's the precise lack of this activity that makes AI in math so reprehensible.

Your argument encapsulates a contradiction because human mathematicians wouldn't be dropping proofs arbitrarily like AI is doing. They would do something completely different. Even the best of them.

reply
Gauss was generally quite secretive and Ramanujan would famously tell people answers that he had received from divine inspiration, often with no ability to articulate how he knew. Von Neumann did just go into random fields and revolutionize them. If the three of them did come back from the dead and form a little powerhouse group that barely collaborated with the outside and just started publishing results for everyone else to try to keep up with, they'd no doubt still be considered geniuses.

Give it six months and models might be able to explain things better than any human. They can already collaborate perfectly well if you ask them to. e.g. there was a post here a couple months ago where Tao shared his ChatGPT logs[0].

If you're not inspired by the ability to talk to a superintelligent machine, and can't find what you'd want to know, that's a you problem.

[0] https://news.ycombinator.com/item?id=49010345

reply
> Give it six months

Ah, the "six months till AGI" meme, but unironically :)

Also, before citing Terence Tao on LLMs maybe you should read what he has to say about it...

reply
It's been doing all of the actual coding part of my job for the better part of a year, and you're commenting on a post about how it just released another round of math breakthroughs, besting a bunch of top humans. It can search the web and analyze documents it finds for me. It can do reverse engineering. It can analyze and create images.

Not sure what your definition of AGI is, but it clearly has superhuman performance on most knowledge work already. Do you think after already having demonstrated that it can solve top problems, that the final frontier it won't be able to cross is explaining its solutions to the experts that were researching those problems, and eventually to e.g. grad student or postdoc level practitioners as a lecture course/set of notes?

reply
The only thing potentially stopping these models from also outputting new theories along the way is the goal they were given.

I have to assume OpenAI is only prompting to solve problems, presumably they could also prompt to not interesting new theories or paths of research found along the way as well.

reply
OpenAI is doing problems because they know they can't do higher theory yet.
reply
I asusme they're doing problems because its an easy way to turn $40m of someone else's money into a catchy news headline.
reply
I think the crosswords framing is a little silly, but I have to wonder what comes when we use our technology to optimize the fun and interesting parts out of every job. There's only so many years of my life I can dedicate to back-and-forths with a chatbot. What if we advance our glorious civilization but our jobs just get more and more thoughtless and miserable?
reply
I don't know about you, but my job has become a lot more fun ever since it's become a lot more back-and-forth with the robot. It does all the tedious things for me. It gathers data. It creates prototypes. It makes the mechanical code changes that I want. It allows me to talk with it for a design discussion, and then my design simply appears. I ask it for monitoring dashboards and they simply appear. It records what we talked about, which is something that I never do.

Largely I thought that this is what you do once you're established in math (or any field) anyway. You have some ideas, but the details are kind of too tedious for you to work out, so you give it to grad students/postdocs. Senior engineers have some ideas, but the details are tedious to work out, so you give them to junior engineers.

Now, obviously in the meantime, there's the question of how do we train the next generation? Or do we need to train the next generation? And maybe while we work that out the answer becomes more shadowing/apprenticeship instead of farming out easy tasks.

reply
I think that's where people hope some kind if UBI or "universal high income" will save the day. Just don't think too hard about how it would actually be paid for, or how we can all have high income when that's a relative measure and we're all given the same amount of table scraps.
reply
"universal high income" is not when everyone has high income, it's when everyone who doesn't have a high income is excluded from the universe. There will be few high income people, robots those people own, and the rest of us will be undesirables/illegals/felons/noncitizens of Ms-Apple-Meta-Tesla-Google-topia, who for arbitrary reasons XYZ (they didn't accept the EULA!) don't deserve universal high income (i.e. most people here will fall into that category).
reply
What you're describing could well be how it ends up, but that isn't the future described by universal high income.

Yours is more likely in my opinion though, mainly because universal high income is completely infeasible and shaky even at the level of definition.

reply
Then work part time, and enjoy your higher wealth to have fun in free time. Don't demand to have your cake and eat it too.
reply
We're going to have a very different perspective on purpose going forward with these results. This has crossed a rubicon where human output itself is going to be completely outclassed by machines and we will have to find meaning elsewhere in life.
reply
Then you don't understand the process at all. You will get something back, you will get an immense amount back. But (almost always) not directly. A mathematician will not suddenly solve a theorem that will enable a cure for cancer or better solar panels or whatever. But working in mathematics will build the gradual understanding that will enable those practical breakthroughs to take place. It's also the most important part of how the people that create those technical breakthroughs will be trained.
reply
This is a really confusing take.

If someone can solve open problems in mathematics then they should do so, isn't it as simple as that?

They should let the public use the models as well, but I guess they have no real moral imperative to do so.

But asking them to stop solving problems is just weird.

reply
If your only measure of advancing is getting an answer, but not building the capability to understand it, then civilization has advanced.

It’s not a human focused civilization, which is where the issue comes up.

As an example: A constant issue I am seeing with AI productivity is that the most productive use of AI is when it is paired with more experienced users, while AI also does more work for entry level workers, if not replacing them entirely. It has become a question where will the future buffer of experienced seniors come from.

This is an example of where simply chopping down trees for today, doesn’t make civilization better off tomorrow.

AI is producing more content than ever before, but our ability to understand and verify it is not keeping pace.

We don’t know if these are unsolvable problems at this stage. Society could come up with workarounds and solutions to these issues in several years.

The request to stop, is part of the process by which the issues are debated and solutions found. It doesn’t mean their position is weird or moot.

reply
If someone gets the answer sooner than you, that doesn't inhibit you developing your understanding of the answer privately the same way you would have done if they hadn't got the answer. I don't see how anybody loses by the answer being discovered sooner.
reply
Not true. If I know the answer to a puzzle, I don't spend the time doing the puzzle.

If there is a prize associated with doing a puzzle, and a machine does it, then what incentive is there to pursue it.

Again, if you are only concerned with the outcome, and you have a preferred answer that you want (in this case "just use AI to advance faster"), then any information that doesn't support that case is useless or misguided at worst.

I am not trying to dissuade you from your preference. I am flagging that there is a set of other factors that influence the behavior of others, how that behavior is critical to the creation of expertise and drive, and thus why others hold different positions.

reply
If you're concerned with something other than the answer, then the fact that the answer is already known hasn't actually provided the thing you're concerned about, so you can still do the thing you are concerned about.

If another human was likely to get the answer before you would you also discourage them from doing it because they would rob you of the chance to do the thing you're concerned about?

reply
This is an ethical and moral question being added here.

Would it be unethical to dissuade someone else from enjoying the benefits of the process you wish to enjoy ?

Vs

Would it be unethical to stop a machine from data mining all the possible questions you wish to explore/enjoy.

And on another level - I am concerned with a bit more than just the answer. I am concerned with what system is in place to ask more questions and get more answers.

There is nothing in this argument that says that we won’t find some other way to study the subject. Maybe people will become monks and do math as a hobby.

We may end up in a daemon filled world, like 40k, where any hope of understanding the tech around us is impossible. (More impossible that today)

reply
If someone spends their entire career not solving the puzzle, did they really learn to understand how to solve it?

They may very well have learned plenty of things and solved or discovered other puzzles, but if the first puzzle is worth pursuing because the solution is actually useful it seems liked we're better off with the solution than a bunch of failed attempts.

That said, I do question the value of solving many of these types of math problems. I'm no mathematician so I'm assuming I'm wrong here, but on the surface many seem mostly theoretical puzzles with little or no practical use.

reply
Yes? We haven’t solved many puzzles about reality, but even half proofs and conjectures create tools that other people use to make progress.

I’ve made this point elsewhere but the debate here is between two different philosophical positions. Results vs process.

If all you care about is the results then the process doesn’t matter.

If a person is starving or needs medicine, then a long discussion on process is inhumane. They need results.

If the conversation is about process though, then focusing on the results is missing the point.

I’d say the question for results oriented people is what are the benefits of the process and at what point does it make sense to optimize for results vs process.

reply
My read on much of the discussion here is that the debate is whether we want AIs solving problems that career mathematicians may spend a lifetime on and still not solve.

When the topic is about careers the question really has to be about results. Even if the results are made by solving different problems discovered along the way towards their original problem, it still has to be about those results.

There is absolutely a question of whether burning these resources is useful when the only outcome is a solution to a potentially obscure math problem, but that is more a question of prompting and goals rather than the use of these tools themselves.

reply
> There is absolutely a question of whether burning these resources is useful when the only outcome is a solution to a potentially obscure math problem, but that is more a question of prompting and goals rather than the use of these tools themselves.

Could you elaborate?

reply
But isn't all of schooling literally learning solutions others solved before us?

We spend most of our young lives (many of us our entire lives) studying physics, math, etc. that others have solved. (e.g Quantum Mechanics, Relativity, Calculus, etc.)

Biology consists, almost entirely, of studying solved problems in nature.

Aren't AI breakthroughs just more to study?

reply
https://mathstodon.xyz/@tao/117237320796901560

Terence Tao’s “don’t create the open problem strip miner”

reply
That doesn't answer the question. Assume today is not the stopping point, and that we end up with super-intelligent theory building AIs. Better than any current-day human. And better at explaining, creating visualizations, etc. than any current day human.

Why is it a problem that the professor is now a robot, and that humans could spend arbitrarily long learning from it and even after 15 years of masters-style advanced graduate lecture courses still have deeper still levels of the topic that the AI could teach them?

And if they never do reach that level of ultra-competence, well, then we found the niche for humans to continue to exist within.

reply
What is preventing these crossword solvers from not looking at the advanced crossword solutions?

Mathematicians and academics in their ivory towers are forgetting that everything is getting automated. They want to carve out fun problem solving niches that's fine but who's going to fund that? If they want to be funded by the society/civilization their argument can't be leave advanced fun problems for their hobby.

reply
Here's a fun quote:

https://proofsandprompts.com/2026/09/10/open-letter-about-th...

>Participation in an event so closely associated with Anthropic and OpenAI could plausibly negatively impact the future reputations of participants.

Given how much power advisors etc have over students in academia, interpret it as you wish.

reply
Its worth noting though that you are comparing a profession with a hobby.

People go to said crossword group to enjoy the process of solving the puzzles. It doesn't actually matter if they have been solved yet or not, case in point the NY Times puzzles are enjoyed by more than just the first to solve them.

Professional mathematicians are ultimately being paid to solve the problems for a (hopefully) practical reason. Its always excellent when a person enjoys the process of the work they are paid to do, but ultimately they are still paid to do the work. I really hope your argument isn't that we should collectively be funding mathematicians to solve problems simply doe the love of the game.

reply
> Professional mathematicians are ultimately being paid to solve the problems for a (hopefully) practical reason.

They are paid for the same reasons the NEA pays artists: out of a sense of obligation to demonstrate elite culture. The track record of practicality of pure math after WWII is essentially 0.

reply
While I don't disagree, I think any justification for why we should fund mathematics and why we should protect the work they are doing from being solved without them should be grounded in results.

Similarly I wouldn't expect a good argument could be made that AI tools should be prevented from creating art because we want to continue funding artists.

If the goal of said funding is just to let them spend their time doing it then it doesn't matter that AI is doing it as well.

reply
Classic alignment problem.

Despite nobody at openAI thinking of themselves as an asshole; despite society urging openAI not to be an asshole; despite the fact that being an asshole is entirely unnecessary even to accomplish whatever objective they are setting out to accomplish; despite everyone at openAI loudly declaring: we are not assholes!

They are still assholes.

reply
reddit comment
reply
This is maybe the lowest-quality comment on a thread full of them. Do better.
reply
On the contrary, I found it a nice piece of rethoric to reflect on how misaligned incentives can overrule each individual's preferences in order to induce the group to take the opposite path.
reply
It's done in jest but I think I am accurately pointing out the interesting parallels between what these companies say they are doing (aligning models) and what they are not doing (aligning themselves).

If you listen to them, and you don't have to listen very hard to hear it, basically everyone at these labs is telling us that this technology is extremely dangerous and should be slowed down or paused entirely. Yet, they, the only entities with the power to actually do anything about it, are not acting AT ALL as if that's the case. They are all barrelling forward as quickly as possible. RSI, THE number one risk according to these guys, is being adopted at breakneck pace up and down the stack, from designing silicon, to training, to inference.

It's ridiculous and insane and I believe can be accurately summed up as, they are being assholes, because if they are actually right about this we are all gonna die. At the very least, and far more likely, every fun creative expressive human thing that is machine legible will be replaced by a torrent of machine slop. It's not "benefiting humanity." These mathematicians are telling you it's not benefiting humanity. It sucks.

Alignment problem.

reply
This analogy is silly because (a) math is not primarily for entertainment, (b) we aren't going to run out of math proofs, and (c) results build on top of other results, having more results proven makes all math more powerful and useful.
reply
Hmmm but in the case of math, while some of it is "just puzzles" there often turns out to be practical applications, even if they are not obvious at first. Number theory was considered the epitome of pure math with no practical applications for centuries, now our modern society is built on it (public key crypto).
reply
If the crosswords were purely games that would be no problem. These crosswords seem to power physics, chemistry, engineering and science applications. These professions would not mind it too much.
reply
Blah blah blah. They are free to do their own mathematics and/or spend time on polishing/reviewing proofs dumped by ai. But they don't get to make demands like don't test math on proprietary models. Idiots.
reply
Math doesn't belong to academics. We don't pay them to work on problems for fun. They will just need to re-evaluate where the value their provide is. It won't be solving problems anymore. Hopefully it will be making them understandable by others at least till AI can't do that as well.
reply
"They will just need to re-evaluate where the value their provide is."

That is fine to say when it is not your field. I guarantee you feel different when it is the thing you care about, that gives you joy, that defines your status. Think about how many sheldon-equivalents insist on being called Dr. (non medical)

It is part of what people use to define themselves. Its going to hurt. There may even be a Bulterian Jihad

reply
Not our field? Most of us are programmers here.

It is clear to me that any competent person with a little patience can now build software better than what I used to build by hand.

reply
> Think about how many sheldon-equivalents insist on being called Dr. (non medical)

Why do physicians insist on calling themselves Dr. (medical)?

reply
No, you dislike maths to the point you prefer paying others to do it. Actual mathematicians are largely doing it for fun, but are now effectively saying "stop destroying our fun or we'll stop doing maths", and you will have to do the maths yourself.
reply
Well, they do they?

Whole sections of the economy are being upheaved by AI, and there is no reason to make a special case for the mathematicians anymore than for the illustrators, developers, translators, HR, etc.

reply
Oh right, how rude of me to only talk about mathematicians in this thread about the future prospects of children in Sudan. Of course this is the place to make "what about the illustrators" argument.
reply
It isn't some law of nature. Humans/societies have agency - what AI should or should not be used is up for debate and decisions. It might even wind up the other way around that using AI is the special case - who knows.
reply
> what AI should or should not be used is up for debate and decisions.

Of course; but it's very hypocritical to raise these feelings only when mathematicians are affected, whereas all the above professions are just told to adapt to the new way of things.

For sure though, translators don't have the same clout and social status as mathematicians do.

reply
I actually really like math and I can't wait for the day LLMs not only solve difficult problems but can also explain the solutions to me.

Mathematicians do a terrible job here. They use inconsistent symbols they don't even explain. They often obfuscate the main idea just to make the paper longer. If you are not part of a small club you are not meant to understand it. I think this is a terrible approach and I am eagerly waiting for AI to do a better job!

reply
But won't new humans take their place that will be the ones who enjoy deciphering AI solutions?

It just seems that this class of mathematicians is being "disrupted".

The field is changing and a new class of mathematicians will take their place.

This happens all the time in fields as technology disrupts them.

A new class of individuals, with different motivations, take the place of the old guard.

I'm sure the motivations of individuals involved in designing and manufacturing cars changed as Henry Ford introduced the factor line.

But that old crop of humans either adapted or retired.

But, plenty of humans took their place with new motivations and automotive technology continued to progress.

I personally feel math will indeed move faster as a result of these breakthroughs. And the humans that take the place of the old guard will have different passions and motivations than the current group.

Maybe the new group will be productivity motivated rather than motivated by the love of tinkering with a single problem for years.

reply
> Maybe the new group will be productivity motivated rather than motivated by the love of tinkering with a single problem for years.

Sounds like salaries for mathematicians need to start going up if we stop paying them with fun.

reply
There's no way to spin this that doesn't make it sound like assholes being gatekeepers.
reply
Here's a fun quote:

https://proofsandprompts.com/2026/09/10/open-letter-about-th...

>Participation in an event so closely associated with Anthropic and OpenAI could plausibly negatively impact the future reputations of participants.

Given how much power advisors etc have over students in academia, interpret it as you wish.

reply
I’m sorry; but if mathematicians are in it because puzzle club is fun, then they should go join the fucking puzzle club and stop impeding scientific progress.

Science isn’t some passive busywork thing where you tie your hands behind your back because it isn’t fair on others to solve all the neat problems - or at least it shouldn’t be.

If your idea of science is leather patches on tweed suits and the quiet ticking of a clock while you do crosswords, then this is an argument in favour of letting the AI do the work so you can focus on your sudoku book in your slippers.

reply
Keeping the tech proprietary so that it can only be used on these problems by internal teams is the very definition of gatekeeping.
reply
It's more like, "don't just casually destroy our hobby / career field", without letting us participate even a little.

The picture I have in mind is OpenAI running their most advanced model in a loop over all the open mathematical problems they can find, just to verify that the model is indeed very smart. Neither the company nor the model actually care about the problems, it's just a cheap exercise machine for them, but the problems get solved and mathematicians don't even get to participate.

Like, even those who accepted the "centaur" thinking, man + machine, won't benefit because by the time they get their hands on good enough models, everything is already done.

It's an emotional thing first and foremost - people who care about the thing can't do the thing, because it's already been done by those who couldn't care less about it.

And before someone goes "poor mathematicians", a food for thought: this is just an early instance of what looks like our shared destiny.

I said here before: given the economics of progress in AI and robotics, it's obvious what the natural division of labor is: computers do the thinking, humans do the menial, manual labor. AI will do politics and philosophy, so you have more time to fold laundry and scrub the toilet.

reply
So what is mathematics then? A fun hobby akin to chess or sudoku?

Are we gonna get the same pushback from medical researchers if the models cure xyz diseases?

I absolutely understand the emotional connection to their work and the heartbreak, but mathematics doesn't exist for their pleasure, it exists to provide tools to solve humanitie's problems.

reply
> So what is mathematics then? A fun hobby akin to chess or sudoku?

Some of it, yes. Much like physics. Both have a track record of producing technological breakthroughs every now and then, but it's not why people are doing it.

> Are we gonna get the same pushback from medical researchers if the models cure xyz diseases?

For better or worse, yes. We already are. In my country, there's a big spat between radiologists and cardiologists right now, that boils down to the progress of technology allowing the former to answer questions that, before, involved a procedure that was a big money-maker for the latter.

reply
What you say reminds me of medical schools in Tunisia.

The general body of research points that more doctors lowers all cause mortality ( with diminishing returns) but Tunisia is still far lower than the Eu average.

Yet Doctors and med Student unions do lobby very heavily against expanding admission to the public uni or allowing private unis.

So we have the weird situation where people go and study in Romania ( making Tunisia lose hard currency that it really needs).

These doctors have taken an oath and the direct consequence of their lobbying is literally more deaths.

reply
USA is the same. Even worse, the doctors guild writes the rules for creating new doctors. It got so bad that we now have 2 or 3 other alternate/adjacent categories of doctors and nurses to work around the bottleneck. Of course then they formed guilds to continue the cycle.
reply
Dude, doctors are humans just like rest of us. They want careers, money, safety, raise children in best way possible, fun in life and so on. I see this unspoken expectation over and over - why are they not infallible, how could they do mistake XYZ, why are they not working themselves to the (early) death for benefits of us all and so on. They have no obligation to stay at place Q just because some folks would consider it convenient. They have no obligation to stay in some place thats not suiting them just because they swore Hippocratic oath, lives can be saved elsewhere too.

Obviously this is often coming from folks who act in same ways as they criticize and usually don't contribute even a fraction back to society compared to doctors. Folks who do mistakes in their lives all the time yet thats fine since we are all humans or similar, right.

So please stop this cheap framing and accusations. If Tunisia wants more doctors and keep them there are ways to do it, society as a whole needs to decide what they want and act upon it. Otherwise, smart skilled folks will keep going for better lives elsewhere, just like everybody else.

reply
Is this not greed?
reply
It's self-interest.

Everyone (near enough) has some degree of self-interest. If you apply for a job and discover that some other applicant is about as well fitted to it as you and in more need of money, do you withdraw? If you see a $20 note on the ground and no one else around who might have dropped it, do you refrain from picking it up if you think you're better-off than the median person who might walk past next? If you see something you want going for a very good price on eBay, do you contact the seller and say "I think you should be making me pay more for this"?

Unless you are an extremely unusual person, the answers to those questions are somewhere between "no" and "of course not, and why would you even ask?".

If someone is working as a doctor, their work is already benefiting others substantially more than the typical person's. (At least, I think it is; it's certainly doing so more directly.) Being a doctor doesn't put them under some unique obligation never to give any priority to their own interests when, e.g., choosing what job to take where.

If they can save 0.2 lives per day for $50k/year in one place and save 0.19 lives per day for $200k/year in another, it would be virtuous for them to do the former but I can't see that it's obligatory. In the case we're talking about, it might actually be 0.2 lives per day for $50k/year versus 0.21 lives per day for $200k/year, because somewhere that can afford to pay them more can probably also afford better equipment, more ambulances, etc. (In case it isn't obvious, all actual numbers here are made up and nothing I'm saying depends on exactly what they are, only on the rough relationships between them.)

It seems to me like any principle that would oblige them to pick the first of those options over the second would e.g. also oblige all of us who have well paid jobs to give most of what we earn to life-saving charities. Some people do that. It's a virtuous and commendable thing. It would doubtless be better if more people did. But, as you might have noticed, very very few people do that and by and large we don't consider it outrageous that they don't, and I don't see why doctors in particular should be condemned when they don't do it.

(Since clearly unassisted human nature isn't going to make everyone behave in such a way, it seems to me that if we wanted that sort of thing then it would need to be imposed by force. Which in fact everyone might be OK with, in the same sort of way as players of high-level sports are OK with having externally-imposed safety rules so that we don't get everyone playing in increasingly dangerous ways for the sake of a small advantage over people who are being more careful. And, in fact, we do have that sort of thing and it is imposed by force; it's called taxation, and actually I think it's a beautiful thing even though there's plenty to dislike about every actually-existing regime of taxes and benefits. This is mostly a digression, but note that it means that if a doctor chooses to go somewhere where they're paid better it probably also means that they're contributing more to the general welfare in taxes. There are plenty of nits one could pick with this remark, but it still seems worth making.)

reply
At high levels, often yes. At lower levels, often it's job security.

Most doctors aren't running departments in major hospitals, or advising government on policy. They don't earn the big bucks. And even hospitals themselves tend to run in the red all the time; it's sometimes hard to disentangle where greed ends, and longer-term interests of patients begin, as you have multiple people and organizations pulling in different directions for different reasons.

RE private medical universities, N=1 but in Poland we have a private provider pushing hard for training their own doctors "because public system is too slow and limited", and it's hard to tell whether they have a point, or whether it's a private-driven attempt at privatizing national healthcare, or a mix of both.

reply
>but mathematics doesn't exist for their pleasure, it exists to provide tools to solve humanitie's problems.

The risk here is that this does do fundamental long-term damage to mathematics as a viable field.

Virtually no one is going to want to take on the risk of PhD-level math work, studying a narrow problem for four years or so to arrive at an impressive incremental result, when there's a sword of damocles hanging over their head every day that an internal system held by an oracle they don't have access to may scoop their results and turn those four years into dust.

To some extent, that sword of damocles always existed in a de minimus sense in the form of other mathematicians. But everyone was playing the same game, coming to the game with the same arsenal limited by human cognition.

If the game board becomes irrevocably tilted, new entrants have no incentive to play except as a hobby. But few hobbyists can devote years of work to understanding and pushing the frontier. It could well mean existential damage to mathematics as a field.

Whether that might undermine math's ability to solve humanity's problems in the long term is almost an economics problem, not unlike the question of whether and when the existence of monopolies ultimately restricts long-term economic growth. Much probably depends on whether intellectual monopolies or oligopolies are being created that will supplant the existing mathematics "economy".

reply
deleted
reply
> The risk here is that this does do fundamental long-term damage to mathematics as a viable field.

All the commotion evens out: It's much easier to learn maths than ever before; you don't need to go to lectures any more; you don't need to learn from a specialist (advisor, lecturer) any more; it all costs much less than it used to.

So mathematics will continue to advance, albeit differently from before. The social structures will not survive however.

reply
Certainly it'll result in a boom for hobby mathematics, and it'll be a hobby at a much more advanced level than before. Whether those hobbyists can continue to push the actual frontier, particularly if AI models operating along that frontier are not made accessible to hobbyists (either via corporate/AI lab gatekeeping, via pricing, or via significant time lags) is a different question. I'm a little more confident in a future where hobbyists push the frontier in applied mathematics than in pure mathematics.

There's probably a loose and deeply imperfect analogy with computing: via democratization hobbyists have made a big impact in applied operating systems development (Linux/OpenBSD) but have been less successful/impactful in OS research (whither Hurd...) or in cost-heavy fields like microprocessor design.

reply
> Are we gonna get the same pushback from medical researchers if the models cure xyz diseases?

Lol. As long as the process aka trials is respected not many would complain.

The feedback loop required to make progress is very different in medicine compared to math.

reply
The trials process is the moat. There's already founders using AI to treat their cancers, and it's all about skipping trials and jumping straight to "I consent, I'll fund it, let's try it". The general public might get access to this in 10 years, but employees at AI companies will have access much much sooner.

https://sytse.com/cancer/

reply
I don't necessarily see a problem with it: if people want to try experimental therapy on themselves and can fund it, then as long as it's expensive, let them - that speeds up research. The problem with allowing anyone to opt out of safety trials is that it then creates pressure from doctors and family members to try, and then it becomes non-consensual in practice.
reply
Yeah it's more like personalized therapy - often the only hope for rare diseases.

While AI has definitely helped quite a bit I am wondering how much all this research and treatments cost. Not sure the current health systems could sustain this for _everyone affected_. If ai enables it all the better.

reply
What's the success rate there?
reply
At least in Sid's case, it went from the oncologist saying "I have no more drugs I would recommend, no trials available" (slide 7) to "I currently have no evidence of disease" (slide 18). I don't know beyond that or beyond Sid's case - or a similar story of an Australian who treated a cancer tumour their dog had with a similar AI / personalized vaccine process.

My understanding of what Sid's describing is that you do RNA sequencing, a whole genome sequencing, feed that into frontier AI (if it will still let you), and somewhere along the way give the information the AI finds to people who can use it make a personalized mRNA vaccine, specifically for you and your cancer.

Another link here about Sid's case, it explains it didn't go through trials: "made possible through a compassionate use allowance from the U.S. Food and Drug Administration (FDA)".

https://www.houstonmethodist.org/newsroom/houston-methodist-...

I am not medical, so I'm happy for someone who understands better to come in and explain all the myriad ways I am wrong.

reply
Trudging into the technicalities of the example still doesn't undo the question of "What is the point of mathematics? To find answers or to be a hobby?"

It's tempting to say "both", but that misses that AI is now forcing us to pick one.

reply
The AI is not forcing us to pick one, it already decided for us.

As 'ogogmad said upthread:

> mathematics will continue to advance, albeit differently from before. The social structures will not survive however.

reply
What if the point of mathematics is to be mature enough to study and teach math to help humans understand it, without the ego stroke of being the first to solve a problem? Bad communicators are upset that a robot is better than they are solving problems.
reply
I'd definitely say both and the cultural component is becoming more and more important to keep up as AI capabilities increase.
reply
> mathematics doesn't exist for their pleasure, it exists to provide tools to solve humanitie's problems

Who decreed that? Mathematics predates capitalism and publish-or-perish by a couple of millennia. Euclid’s Elements were not written to benefit the weapons or medical industry.

reply
Who decreed that they are entitled to get paid for that?

Maybe this hurts more than it should do because of publish-or-perish.

reply
Mathematicians have been unpaid for centuries. The problem at hand is much deeper then just deciding who gets the taxpayer money.
reply
And they can continue to do unpaid mathematics

But humanity is not going to sit around and wait for solutions just so hobbyists can have a moment of glory.

reply
Why? Elements wasn't a 500 clever puzzle solutions.
reply
“ AI will do politics and philosophy””

Incredibly delusional and disconnected from the vast majority of people who are voters.

reply
"AI will do politics"

If only.

They certainly can't do them worse than humans.

reply
Politics is for humans, it's not meant to be automated.
reply
I'm pretty sure the "proprietary" part is the gatekeeping.
reply
It's not like every disadvantaged kid now can solve a major problem just by sinking a hundred hours in their ChatGPT 8 instance.
reply
Sure, and sometimes gates are needed. That's why we all run spamfilters, those are definitely gatekeepers.

In this instance however, it's openAI and Anthropic that are pushing people out of the field by running secret models that take the interesting work away and leaves the persons having to review endless slop proofs.

reply
You mean by the companies right?
reply
There has never been a stronger need for people to band together and "seize the means of production" for this stuff. The advances being made are ours, not theirs. It's trained on our work, our knowledge.
reply
That's an absurd idea. The work & knowledge this is trained on is public. You have access to it.

What you didn't make is the AI training process and resulting model. Extremely hard working people built that, and it has value in itself.

Without the AI training process, the model is useless. Otherwise we'd already have been here at GPT-3.

reply
> The work & knowledge this is trained on is public.

That's an incredibly generous take. If I'd pulled a fraction of the shenanigans prominent companies have to obtain data I'd be thrown under a prison to the thunderous applause of those who have, and are, doing much worse.

reply
> The work & knowledge this is trained on is public. You have access to it.

I’m interested in how you can support this assertion as it seems at odds with established copyright law

reply
We _think_ this power / divide feels harmless right now, but I'd bet money that NSA, CIA, etc have access to the latest and greatest unrestricted models; and massive compute. At least for OpenAI, and even if not willingly for Anthropic, I'd bet money NSA has it too. (After all, when Google decided to migrate to HTTPS, the NSA decided to hack Google's internal network to preserve their taps).

Who knows what they are up to.

reply
One thing I've wondered about in this respect is what happens if NSA learns 5000 new units of math while the general public learns 4000 new units of math.

This sort of happened at various times in the past, because they hired and/or funded so many mathematicians, and especially before the late 1970s they had many of them working in areas where academic mathematicians weren't working at all, so they were learning more math, or more math that they especially cared about, than the public was. (I was going to write a note here just a few days ago about how NSA has had a "Classified Mathematics Library" for many years.)

For vulnerability scanning, I think the new-capabilities trajectory is good (in the sense of "it will help defenders win") even if governments find ways to get more of it, because there are finitely many bugs and classes of bugs, so at some point more capable models' or longer runs' advantage over less capable models and shorter runs should stop helping them outcompete the less-well-funded defenders, because the defenders will still have learned most of the information that's relevant to achieving successful defenses.

So if NSA gets 5000 units of vulnerability scanning and the public only gets 4000 units, we might still just wipe out all of the pure software vulnerabilities and then go back to worrying about physical supply chain security or side channels or something.

For math, I'm not quite sure! For one thing, there may be things that have no feasibly deployable defense at all even when you understand the underlying mathematics (I'm especially worried about traffic analysis here, because understanding in detail how traffic analysis is done, or how powerful particular techniques are, does not necessarily always or usually make defending against it more convenient or less costly). In a more science fiction scenario, there might also not be any efficient secure cryptographic primitives of some kind, like if it turns out P=NP with reasonably small exponents and reasonably small constant factors.

reply
Based on people I've talked to I'd be really surprised if this was the case, they actually seem to be pretty far behind the ball when it comes to AI use. Which makes sense to me, given the sensitive nature of their data and systems, they don't want to turn on yolo mode and let an agent cook unattended, which is what you need to do to make these discoveries.
reply
I believe it would be a complete failure of the state and frankly downright irresponsible behavior if all the three letter institutions didn't have access to these models and I’m not even a US national nor do I live there. It’s just common sense. Obviously it wouldn’t be public information since it’s national security, but it’s the lowest hanging asymmetric advantage in the history of national security of nations.
reply
I'm wondering what's the impact on human Mathematicians, and especially would-be Mathematicians -- master students, if they HAVE to use AI in their daily life?

Would that impact their own ability of solving Mathematics problems? I mean as a programmer I'm already seeing that impact on the programmers -- sure the best of us can leverage AI to achieve unimaginable things, but many of us are simply vibe coding.

Of course we can assume that it is only the best of us that really matters, and the rest of us are not going to produce anything substantially useful ANYWAY, it might as well to replace the rest of us with AI, but my worry is -- does that really have ZERO impact on the human specie's ability to produce "the best of us"? After all, they don't grow on trees.

reply
It's a grand experiment isn't it? Us senior programmers are pretty good at using AI (or so we think) because we have decades of grinding and problem solving to inform our intuitions. Is that really necessary? The next generation of programmers certainly will not have that level of desk-head interface. Maybe they'll be fine? Maybe the models will get so good it won't matter? Open question.

I imagine the same will be true of AI, but I'll say that in the short term AI is going to make mathematicians better because it solves the breadth problem. Again, I feel like this Barnette conjecture got solved (if it is solved) because of some clever partition function sums which are intellectually tractable but simply too far out of anything I'd seen before (I see the apparition of my GT combinatorics professor intoning gravely that "everyone knows that, Jake, you're an idiot"). Maybe AI will help identify common threads far greater than Google and journal search.

I think if I had ChatGPT when I was 20 and working on this problem for the first time I might not have solved it, but I would have learned every angle and facet of it far more quickly. But then again I would not have spent so many late nights staring at the Országház across the Danube and letting my mind drift and bump against the problem like spilled cargo in the river.

reply
I have been thinking about this, too. Take Mathematics as an example — it’s probably safe to say that only the top 1000 contemporary Mathematicians really matter to the human specie, or perhaps even less. And if you do not show the potential to be one of those when you reach the end of your graduate studies (actually probably already too late), you are 99.999% sure to just push out papers no one reads and such, and an associate professor in a no name school is going to be your lifetime high watermark. Like, the human specie doesn’t care whether you existed or not, from that perspective.

Now if we can prove this, expand it to the whole spectrum of academic studies, and somehow convince 99.99% of us that they are basically garbage and we don’t care about them — sure the elites will throw UBI around but that’s it — then maybe AI is very positive to the human specie.

Oh we better pick up the speed of cloning and artificial fertilization quickly, because people who are told to be garbage probably have no interests in boring children, and it is still a myth how genies are born and grown. We need that diversity.

BTW the whole scheme reads like the background of a Chinese net novel 赛博英雄传.

reply
I'm probably the 1,000,000th ranked contemporary mathematician and I matter a great deal to the human species.
reply
oh joy, eugenics and miscegenation
reply
I think some elites are seriously into these stuffs.
reply
> virtually none of this stuff is possible with technology any normal citizen has access to

So far, it looks like open-weight models are lagging less than a year behind frontier capabilities. And I think one year diffusion of technology from "insider lab demo" to widely available is actually pretty fast?

There are lots of research fields which "normal citizen" has no access to - medical and biological research, particle physics. Some of it is somehow publicly controlled (LHC), some of it not at all (commercial pharma research, mostly secret until the final human trials). And most of it reaches "normal citizens" in way more than a year.

(and I'm talking about open-weight models. The availability of commercial AI models from private preview to included-in-your-$100-subscription is currently like 4 months)

reply
I went back to that Fable chat and showed it this new preprint. It coded up the new constructive algorithm and ran it against the existing test suite, that looks good at least.

It has been super helpful in delineating where the crucial concept came from. The proof is rather simple as graph theory proofs go, but it does seem to use some constructions that would only seem obvious if you had serious physics experience with partition function and calculating energy states that cancel out. It's not a wholly alien bolt from the heavens, but I can also see how there hasn't been a human being with the broad theoretical physics knowledge combined with the deep graph theory experience in planar graphs to come up with this idea. I don't know, I'm looking for precedents of this formulation and some old papers of Penrose counting the number of edge colorings of this same graph type are coming up, the line of argument at least rhymes.

But I agree with the thought that this sort of progress should not be siloed inside those companies. I propose a tax so that every slop cannon AI video pays for another hour of compute time for advancing mathematics.

reply
virtually none of this stuff is possible with technology any normal citizen has access to

I suspect that this might be one of the reasons people inside the labs are scared about AI.

What if they have asked AI how it would wipe out humanity and it came up with reasonable answers that they don’t want to publish unlike they do with these math problems?

I think those models and findings should be investigated.

reply
The ways AI can eliminate humanity are trivial obvious and already published. It's just "let the AI control anything of importance and let it spit out slop"
reply
Anthropic runs a biology wetlab (while denying biology to consumers of even their publicly available models, let alone their inhouse ones that only they can access) so I'd expect AI to generate practical and lucrative products soon.

Cure for aging? What do you reckon that'd be worth?

reply
I always got the sense that solutions for significant "unsolved problems in medicine" would be at least 10 years out from the point of total AI dominance in the theoretical sciences. Doing actual experiments is bottlenecked by real-life constraints (organisms are slow to grow and unpredictable, human laws won't let you build a factory to brute-force biology on a million test tube guinea pigs, let alone humans), and the theoretical side of biology is also relatively underdeveloped, to the point that "solve aging" seems as hard to formulate as Navier-Stokes would have been with 15th-century mathematics.
reply
That would be disaster. It would mean the world would not get rid of trump (and similar) by natural causes. Death is the final - and perhaps the only? - equaliser.
reply
A publicly available AI biology wet lab would likely lead to horrific outcomes as people vibe coded virulent pathogens.
reply
If they find a shortcut (like a viral injected cell-dna damage reset) - that would be big. And can you imagine handling the cure for aging, to societies that still produce exponential people?
reply
A cure that you take once and that's it, your body is that age forever? Now, a supplement that you have to keep taking to stay that biological age, that's where the real money is.
reply
I find it troubling that we will solve aging but won’t solve money
reply
The US spends about 18% (and rising) of its GDP on healthcare, so solving that would go a long way towards solving money.
reply
extremely obvious you don't understand anything about biology
reply
> It's becoming an incredible concentration of power that I don't know that we've ever quite seen before.

Replace “AI” with “supercomputer”.

(Super)computers have been solving many math problems that mathematicians can’t solve. Now they are capable of solving problem types that they weren’t able to solve before. (this applies to other fields as well)

Problem is it’s not clear if there is anything left for humans. Probably yes, since human mathematicians are still more economical.

reply
I want a jet airplane, but I can't afford one, and all the ones that exist are proprietary. How is this different from AI models?
reply
> I want a jet airplane, but I can't afford one, and all the ones that exist are proprietary.

I guess if you worked together with some people who all put some money into a fund, and by using very modern technologies like 3D printing and modern CAD modelling etc., it should be possible even for private people to build a jet airplane.

The problem rather is that the government does an insane amount of gatekeeping to prevent this from happening (enforcing expensive and time-consuming certifications on airplanes and pilots etc.).

reply
You're talking about an end user not being able to afford a luxury item.

The concern is about elite level researchers no longer being able to move the industry forward in a public way, and leaving potentially all major discoveries in private hands going forward.

Possible worst case scenario in your case, you personally miss out on a luxury item.

Possible worst case scenario in the topic case, an AI company controls the only intelligence that discovers and understands the most powerful tools / physics we know of.

reply
You could theoretically run these (slowly) if they were open weight. ~$10k of DDR4 is enough to hold them. The data itself costs ~0 to replicate.
reply
And I can cross the country slowly on a go-kart. Not a substitute.
reply
In a sane world this power would not be allowed in the hands of private corporations.
reply
They no doubt have more expensive/powerful models internally, but smaller models seem to catch up fast. So I'm not sure it's about capabilities, but more the willingness and budget to conduct a huge search.

Obviously the more intelligent the model, the smaller/more directed the search is. But they spoke about huge numbers of agents working on Navier-Stokes for example (I think it cost >$10m).

reply
True. What if the emerging capabilities of their best models are applied to tasks like “maximize the chances this pro-AI candidate wins an election” or “maximize profit via stock trading”. Every advantage compounds until all power in the world with any significance belongs solely to whoever has the best models and most compute.
reply
Totally agree - and not only that we don't know the exact details how these results were produced which is deeply problematic - we just have the end result (and some of the reasoning traces). For this to be a scientific disclsure, we need to know what the agentic setup was, what information was put in, how much and which prior work it relied on, whether the constructions it's using are just ripping off existing work without citation or something it invented (and if so, to what extent) and so on - it's not clear at all what the actual new contribution of the AI model is. All this makes it feel much less like an actual scientific contribution and more like a pre-IPO stunt.

But to me it also signals (as if it didn't before!) a great need for the wider AI community to focus exclusively on researching and building AI algorithms and systems that are more humanistic: completely transparent in its workings and the representations they create, super efficient in terms of data and compute, componentised so that individual entities can plug in different bits and rapidly train on their own data, highly adaptive to individual needs, programmable in a real sense, largely independent of corporate influence, easily accessible to everyone across all social and economic strata, and enable individuals to grow/learn/reach their full potential.

Is this possible? I think so, but it will require ingenuity and bringing in ideas from (ironically enough) some of the deepest areas of modern mathematics such category theory, algebraic topology etc. which are largely about building abstractions that expose the underlying structure of complex mathematical objects and the relationships between them.

It's already happening to a degree, but the urgency has reached epic levels at this point and it needs to happen at scale.

reply
It's a bit aggravating that I cannot interrogate the session that yielded this result and ask it why and where it got the crucial calculation from, or why it went in that direction. It doesn't even rightly know even if it gives you a legible answer, that doesn't have any correlation with whatever happened under the hood.

Humans are the same way sometimes but I guess there's romance in that. If a human had solved it a la Kekulé and said "it came to me in a dream" I would at least understand that.

reply
Math isn't scientific, none of that is "problematic"
reply
Sorry I was using scientific in a broader sense - probably should have used "academic" instead -

it's deeply problematic because they are building on open, public results yet they don't provide information on how people may build on it - its exploitative and exclusionary - at least they are consistent

reply
I find this argument to be extremely ridiculous. They solved some math problems and published the results for free. No one asked them to do it, they weren't paid, and they don't owe anyone anything. Who exactly is exploited and excluded? The entire notion of open public information is that you can do anything you want with it, including build private systems. Is a baker "exploitative and exclusionary" for reading a recipe in a book and then turning around and selling that bread to customers, without sharing the recipe with the customers?
reply
The anti-AI arguments keep morphing, as many could have probably predicted. Starting with "AI can't do anything" to "AI can't do anything useful" to ... "AI breakthroughs are proprietary!#@!!!".

I've seen more goalposts move in the last 3 years than maybe in my whole (lengthy) career up to that point.

reply
> AI math is happening and there's no going back.

> I suspect that this is in fact the source of much of the angst.

Your comment reveals that you absolutely did not read or understand the Field medalists' open letter... Please, why would you refer to their complaints and claim you disagree when you clearly aren't engaging with the arguments presented therein!?

reply
deleted
reply
> I have no problem with AI models making revolutionary advances in math or science. Where I start to have a problem is when the AI models making these advances are tightly withheld, proprietary, and seemingly never released with these capabilities intact.

Agree, and, to my mind - shows why the efforts of the Free Software Foundation have been worthwhile all along. We need software to be open / free / libre or the power elite controlling them will ruin the world.

reply
What exactly are you worried about? OpenAI/etc. gaining too much power? If they use it, the government can stop them. If you worry about the government, isn't it better that than rando terrorists? Seems similar to the early days of nuclear and rocket technology. It took stupendous amounts of money and smart people. It was barely accessible to many countries let alone people.
reply
> What exactly are you worried about? OpenAI/etc. gaining too much power?

Yes. They have already shown to have no scruples when it comes to making profit and to have little to no morals.

> If you worry about the government, isn't it better that than rando terrorists?

In my country the largest terrorist attack was almost certainly financed by Iran and caused roughly one hundred deaths. This number pales compared to the thousands who died during the latest, US-backed military coup, a move that relied on a doctrine that the US has never stopped asserting [1].

And those morals I mentioned earlier from AI companies? They do not apply to me because I'm not a US citizen. So no, I do not think the US government is the "seal of quality" you think it is.

[1] https://en.wikipedia.org/wiki/Monroe_Doctrine

reply
I don't think the comment you're replying to said that the U.S. govt. is a seal of quality, at all. They kind-of implicitly concededed that trusting a government with that power is highly sub-optimal, but better still than allowing it to get into the hands of terrorists. Which is a very real issue and a nontrivial point of tension. Like, I'm sorry, maybe I'm reading into this too much, but I personally see the "the government is not the seal of quality you think it is" as a rude and even patronizing misinterpretation happening far too often in discussions, and as needlessly diverging attention from the crux of the problem.
reply
I want to push back on "better than getting into the hands of terrorists being a very real issue".

I am currently in Germany. In the 21st Century roughly 60 people have been killed and 160 injured in ~40 terrorist attacks, most of them perpetrated with cars or knives [1]. In comparison, the US' war in Iran has costed Germany 2.781 billion dollars in fuel costs this year alone and the US government has publicly announced its plans to interfere in German politics partially by funding far-right activities [2].

My point being: the probabilities of terrorists shaking the world order with AI are rather low, seeing as even the most successful attacks in this century have been performed with the simplest of technologies. In contrast, the probability of the US flexing its power irresponsibly are rather high, seeing as they have been doing it for a couple years now and are, in fact, doing it right now.

As far as I'm concerned, and from an evidence-based, day-to-day point of view, the "AI in the hands of terrorists" is an irrelevant concern while "the US may abuse its power" is not.

[1] https://en.wikipedia.org/wiki/Terrorism_in_Germany

[2] https://www.theguardian.com/us-news/2026/jul/15/germany-warn...

reply
Thank you for your insight.
reply
The US government has shown, time and time again, that they will always side with large corporations. Having them as the last backstop is not reassuring.
reply
Have you considered the possibility that the AI labs could actually become more powerful than the US government precisely because they control this technology?
reply
Universities, at least, should be given access
reply
> OpenAI/etc. gaining too much power? If they use it, the government can stop them.

Has the government stopped Google and Apple? https://news.ycombinator.com/item?id=49964791

reply
I guess the objection to closed source slurries releasing world-shaking mathematical proofs, from a conservative libertarian standpoint, is that it's inherently dangerous to individuals whenever access to information or technology is concentrated too much in one place, whether that's government, private equity, religions, cults, terrorist cells, or anything else.
reply
> AI math is happening and there's no going back

"Math" is about uncovering the epistemological foundations of the universe.

Adding AI here does nothing and is probably a regression in that it diverts resources from actual "math" into some sort of LLM wankery that nobody wants.

reply
That depends on whether the AI-generated mathematics helps with the project of "uncovering the epistemological foundations of the universe".

Which depends on (1) whether there are actual good ideas in it, (2) whether as well as finding the proofs the AIs can explain their ideas in ways humans (and other AIs) can use, and (3) whether the results they prove are ones that really contribute to that rather than being isolated curiosities that don't go anywhere.

I am not expert enough in all these fields, and haven't looked enough at the papers, to assess #1, but in general the way mathematicians have bet is that if you can solve things regarded as important problems you'll usually do so in a way that contains more broadly useful ideas. Differences between how today's AI systems do mathematics and how humans do mathematics might make that less true when it's an AI that solves the problem, but I would still bet that way. I'd be surprised if OpenAI's big math dump didn't turn out to contain some ideas, and connections between ideas, that humans find useful.

At the moment the AIs are worse than good humans at #2. (But some humans are also really bad at #2, including some humans who are very good at proving theorems.) It looks to me as if they're getting better, and I would expect them to continue to do so. I also suspect (but this is only guesswork) that today's publicly-available frontier AIs may be able to answer questions along the lines of "please take a look at this AI-written paper, and tell me what key new ideas it contains and how they relate to other things in the field" well enough to be useful to human mathematicians. (Even when the paper itself was written by a proprietary AI that no one outside OpenAI or Anthropic or Hypothetical New AI Mathematics Lab has access to.)

As for #3, that's always been something of a crapshoot. A lot of mathematicians' effort goes into proving things that approximately no one ever reads or builds on, just as a lot of industrial R&D goes into trying things that don't turn out to make good products. The recent OpenAI dump contains things that sure seem like important building blocks for future mathematics (e.g., the "quasi-Riemann-Hypothesis" thing) but it's hard to know for sure and also hard to know whether, if they do prove things that turn out to be useful, it's only because they've read the human-written literature and aimed at things human beings have said seem likely to be useful.

None of this seems to me like "adding AI here does nothing". Whether what AIs are doing to mathematics at the moment is good on balance is highly debatable, of course, but it's a matter of trading off costs and benefits, rather than there being costs and no benefits.

reply
>>However, on one point I increasingly agree: virtually none of this stuff is possible with technology any normal citizen has access to.

So basically nothing changes, Math was subject to gatekeeping and policing of the worst kind.

If you were not among the geniuses, and it didn't come to you automagically, you were simply supposed to leave it to the people who did get it and go do work for people of your intelligence. Smugness was too much to take.

Math people, like chess people never made any genuine attempt to help people understand the processes and methods that made math happen.

To me it should have been a field as teachable and ubiquitous as accounting.

The net result is once these methods and processes were worked out by AI, it was over for the human mathematicians.

reply
I have very little understanding of higher math, so I ask you: Was the proof due to a type of brute-force solution that could be solved had you gained enough information from reading others' work, or was it more like a proof that was sparked by an insight that came once a clue on how to solve it was put forward? I guess my question is: Was the problem proven by using a collection of everyone's work, or was it due to a brand-new insight?
reply
I'm still digesting the proof and translating a bit from the dual case back to the primal in which I most commonly thought about it. I don't think it was a brute force proof in the sense that it combined every possible paper and commentary. It's rather odd because I feel like most of the work on the conjecture was focused on an induction proof based around graph reductions, and this proof avoided those issues entirely by offering a concrete constructive proof of finding a Hamiltonian cycle. Rather, it explicitly selected the edges not in the Hamiltonian cycle, which is in line with previous attempts via the dual.

The "aha" insight for this is actually f**ing wild, it involves a complex valued exponential sum on the edges. I've seen a lot of clever counting arguments before in graph theory but this is the first time I've seen complex roots and annihilating terms like this, the symbolic manipulation tricks in this look like things out of quantum physics. I don't understand where this trick originated, I need to really digest this.

reply
You should try asking an LLM to look for previous papers using similar ideas. The current/frontier generation of math AI is unfortunately very bad at citing the relevant literature for techniques its using.

I asked GPT here: https://chatgpt.com/share/6ac5fd7d-0390-83ed-a02a-6d80fc64f6... and it says:

> the exact Barnette argument appears quite novel, but nearly every ingredient in its cancellation trick has a recognizable ancestor.

> The closest precedent is much closer than I expected: in fully packed O(n) loop models, people have been assigning complex phases to the two orientations of a loop and making them cancel for decades. At n=0, the phases are literally +I and -I. And the n->0 limit has specifically been used to extract Hamiltonian cycles/walks.

You can judge better than me. But it's definitely worth it having a research assistant AI with you when reading these papers.

reply
So much about LLMs can be framed as Information Retrieval, Compression, and Search. Computers have always been good at ruthlessly hammering through a huge but finite set of possibilities. The wild thing now is that you can define that set of possibilities as "all the ideas ever published in mathematics journals."

It makes solving advanced math problems feel like cracking a hash. If it's possible, it's just a matter of compute time.

reply
BTW, reading your last paragraph reminds me of how Lee Sedol felt after move 37.
reply
Ironic, as I remember staying late at the Google office to watch that match live. I didn't really understand anything going on but I knew enough to be excited. What a decade.
reply
And we’re only a bit more than halfway through this current one. Exciting/terrifying.
reply
I just revisited this to make that exact comment.

I'm sympathetic to the mathematicians who are worried about the future of their field, but as an outsider I wonder if they couldn't learn from the go community's "recovery" after the introduction of an alien intelligence.

reply
Look, I quit Google a decade ago and tried to make a ChatGPT-lite LLM in my living room (turns out 2017 and GTX1080ti era was a shade too early). I knew that this technology was eventually going to revolutionize programming and mathematics and everything else. I am still flummoxed on a daily basis watching it transpire.

But also I am excited to be living through this new era of programming and new era of mathematics. I'm still saddened that I couldn't be the one to solve this old problem, but now I realize that my personal approaches were really solving a level of this problem even stronger than the original conjecture, and I'm energized to tackle those (in my free time between being a solo founder and father of 3, etc.).

reply
Complex roots and annihilating terms -- is it something like the derivation of Fourier / Laplace transform?
reply
Why would the trick have any "origins", isn't this model creating new techniques never before seen or imagined?
reply
There is a chance that someone from a completely different field came up with a solution for a tiny part of your problem.

If you can remember the content of any scientific publication and any book in the world, you are able to make use of this knowledge in every step of you proof.

However, this does now answer how the model came up with the specific route it has taken for the proof.

reply
LLMs don't have super memory like that. I mean I don't know what this internal OAI model is, but at least for other LLMs, they aren't databases of training data with a smart search on top.
reply
The agents here very likely used search. On top of that, they have boundless patience and can quickly process top K hits to find what they need. This is exactly the skill that is super useful for finding various niche sub-proofs that can help you build the final proof. A human mathematician is not going to digest 1000 papers from a different sub-field to find the needle they want, not knowing if it is actually there. AI can do it in few hours.
reply
As Terry Tao said, LLMs are not outsmarting us, they are out remembering us.

I'm fairly sure your understanding is not fully accurate.

reply
I'm not convinced anyone really understands the difference.
reply
I did not mean to say that an LLM knows literally all the publications. But the abstract knowledge is probably encoded in the weights.
reply
No but they have training data which teaches them certain amount of complex understandings and just not math but also physics. So this is one huge advantage.

And then they are for sure able to fill their context based on 'smart search on top' to actually progress further.

reply
As I understand it it's undetermined yet whether LLMs can actually come up with anything novel or are instead pulling from their incredibly deep corpus of knowledge to present solutions that were there but we didn't realize it because our brains aren't libraries of almost all human writing.
reply
Synthetic data allows them to train well past the limits of human writing.
reply
What's an example of synthetic data?
reply
Only in the same sense it's not yet determined about humans, either.
reply
Not so sure. Was everything already "there" before humans existed?
reply
In some form and shape, yes. Humanity's creativity is a lot of marginal copying and remixing.

But obviously, it adds up to something greater than went in; in aggregate, our contributions are something to awe.

But my point is, if you zoom in at the marginal, incremental contributions of any individual human in this process, it's really hard for me to say LLMs are not at the same level already.

On this topic, people like to compare LLMs to Einstein, but as far as I know, Einstein did not zero-shot special relativity in an afternoon. He built it up incrementally over time, it took him three times longer than the time between first ChatGPT release and today, and it depended on centuries of prior art, culminating in the right observation and right notation being available to him in his moment of greatness.

reply
Unless everything was there before humans existed humans created some ideas etc from scratch and not just remixed and copied.

At what level LLMs are is then an entirely separate discussion, I think.

reply
> humans created some ideas etc from scratch and not just remixed and copied.

Name three.

reply
What would you accept as evidence there? Are, for example, the first names/words for colors from scratch?

So your view is that everything was there at the creation of the universe (it's a possible view, of course)? Or are there any "things" that can create ideas from scratch?

reply
Recently I watched a documentary on the tanzanian Hadza tribe, one of the last hunter gatherer tribes on Earth. Their language is a distinct click and pop language and they regularly imitate animal calls (monkeys, baboons, birds) when they hunt but also when they communicate with each other, tell stories etc.

I think it's not impossible that words evolved as adaptations of the environmental sounds with which our ancestors lived. The human creativity producing DNA is also a remix of preexisting molecules formed under evolutionary pressure, so the view that it's turtles all the way down, unintuitive as it is, may not be so indefensible after all.

reply
I mean what is your criterion on invention here? On the one hand, each specific word could be seen as a new invention. On the other hand, all languages basically correlate strongly with the environment of their users - it's why LLMs turn out to be universal translators - and pattern-matching is hardly an invention, isn't it?
reply
But LLMs aren't turtles all the way down, they stop at vector embedded tokenized words.
reply
My view is that LLMs meet the standards by which we judge human creativity/inventiveness, and thus that one cannot claim LLMs "just repeat, never invent" without the same being true about humans.
reply
Pornography, "I Want it That Way" by the Backstreet Boys, torque wrench.
reply
No this is not an issue. As long as their is a way of verifying things, they do the same thing with creating novel things as humans: Searching through an infinite space of possibilities opitmized by knowledge.

They combine things, verify it and if it works and progresses the problem, they created something new.

reply
Let me introduce you to 'obscure Russian mathematicians'.
reply
> Was the problem proven by using a collection of everyone's work, or was it due to a brand-new insight?

Loaded question. A "brand-new insight" is still built off the work of others. A possibly better way to frame it would be in how many subjectively unintuitive logical leaps have been made from prior work.

reply
From my current understanding (and a lot of theoretical physics I'm having to Google because the sentences I'm reading from Fable's analysis are so bizarre I think they are hallucinations) there are possibly 3 neat symbolic tricks borrowed from theoretical physics that make the heart of this proof. Forgive me for posting LLM output but I find this darkly hilarious:

"it's a matrix-tree cancellation wearing Kasteleyn's planar signs, run as a Witten index over Penrose-lineage states, evaluated as a fugacity-zero loop gas in an infinitesimal magnetic field — and the reason it reads like physics is that every one of those tools was built for partition functions"

I thought this was pure slop when I read it but there are some clear analogues in these other areas of physics, really neat computational tricks, and a very interesting paper by Penrose calculating Tait colorings I never knew about previously (extremely relevant, actually related to a separate approach I had once taken on this problem). The problem is that the paper isn't saying "aha, we were inspired by the related problems of pairing excited states and creating spanning trees out of cancelled coefficients" it just defines the function apropos of nothing. Which is kind of like the Jacobian counterexample in that it works but doesn't really explain how exactly it got there.

I really think the load-bearing concept here is "prior work". If prior work is considered papers on this problem or graph theory, yes this has one huge subjectively unintuitive logical leap. If "prior work" is the entire corpus of neat computational tricks that physicists derived to make their equations spit out something other than zero or infinity, maybe it's not so crazy?

reply
I don't have much to add to the math parts, but I've read all your answers in this thread and wanted to thank you for taking the time to offer a detailed perspective from a subject matter expert. Thank you!
reply
Actually reminds me of patent law. Prior art ist a defined term which includes all standard literature on one topic. To evaluate, whether the new solution is really inventive and thus patentable, one consults prior art, selects the most promising starting point, and from there asks oneself if an all-knowing but uncreative specialist would come up with the solution by himself. If he wouldn't, the condition of inventiveness is satisfied.

Makes me wonder how the patent space will be disrupted when that inventiveness step becomes obsolete because of LLMs. Given your example above, it seems like a combination of different methods from many different sources. This would be regarded as inventive, clearly. If eligible patents can now be brute-forced, the bottleneck becomes only selecting the most promising ones and paying for the patent.

reply
Oh man, we should talk. I have been working on a patent with ChatGPT specifically to get around two complementary patents that are now together because of a corporate merger this year. I am not sure how much longer anything is going to be patentable with this kind of design assistance available to everyone.

Also, once upon a time I wanted to be a patent lawyer. It's incredibly hard to sit for the patent bar if you have a pure math degree and don't have an engineering degree. Thankfully New Hampshire lets anyone sit for the FE exam.

reply
Did anyone else wince at seeing the phrase "load-bearing"?
reply
I did as I wrote it. I actually used that phrase often before it became an LLM-ism, just like how I rather enjoyed peppering my writing with em-dashes. Oh well.
reply
Language constructs becoming aggressively passé due to AI saturation is one of the craziest outcomes of all of this stuff—one which I don't think anyone saw coming.

Are there no loads left to be borne?

reply
one hopes at least that the taboo on the bearing of loads is restricted to metaphorical loads only, lest lorry drivers and porters become the next victim of the algospeak spectre
reply
deleted
reply
Kasteleyn signs definitely have math counterparts (Arf invariants). They’re just not as well-known.
reply
Right. And I'm kicking myself for not having the mathematical breadth to know about them.
reply
Why? Physics people I talked to didn't know either.
reply
It's a shame OpenAI will never publish the trace that led to the insight.
reply
Condolences, im familiar with the feeling. I hope this AI thing somehow works out for the better and doesnt end up demotivating bright minds like yourself.
reply
Thanks. It's just funny, I literally spent thousands of hours with this problem over the last two decades, it helped me through some tough times. I'll never quite be able to think about it in the same way again. It was never much more than a hobby for me after I left mathematics as a career but it was something I took seriously for years.

I am not demotivated though, I have a great consumer privacy product coming out soon that I'm very excited about.

reply
My favorite thing about your story is that you wrestled (enjoyably, it sounds) with a known problem for decades, but are finding fulfillment in an open ended problem that is exercising creativity about both problem and solution.

IMO that’s where AI is going: as soon as a problem can be formulated clearly enough, AI will trounce us humans. I have yet to see evidence that it can decide what problems are important at a remotely human level.

reply
I think the next test will be asking an AI to come up with a new branch of mathematics - just letting it rip and telling it to construct a system that doesn't reduce to combinatorics, group theory, graph theory, analysis, etc. Just get wild with it and don't start with any known problem as a jumping off point.

I think something like the Collatz conjecture will be solvable not as number theory or ergodic theory but some other completely wacky environment that humans haven't even sniffed at.

reply
The process is often as valuable as the end result. Sure, you didn't crack the problem, but you gained enormous value in the process. I consider that a win.
reply
If you wrote down any of your thoughts on the open Internet you are probably in some small - or possibly large, unattributed way, responsible for this result being possible.
reply
Which is one reason I never really did. I probably should have but I always thought my attempts were too amateurish. Though I did manage to replicate some partial result papers that I didn't know about, lol. Writing openly would have saved me some years.
reply
Did you feed OpenAI models with your insights though ?
reply
Where can I learn more about your upcoming product?
reply
Shoot me an email, in my bio.
reply
I have this fear too, demotivating individuals with high potential.

But I have an existential dread about it… I don’t see how it cannot, at least in the vast majority of cases. It seems like a grim new reality is emerging where humans can’t contribute any more, and beyond that being incredibly depressing, I also don’t see it playing out well for human relations.

I’d personally much rather risk dying of cancer or facing whatever other fate may await me that these AI labs allege they will fix (with zero evidence yet) than to risk whatever dystopian anti-human future this technology may very well produce. I’d rather my kids have a shot at something, and be guaranteed to die eventually, than to risk them being hopeless in a severely disordered world with a far off promise that they’ll live forever

reply
I think this is going to come down to personal philosophy and religion. And having a strong grounding in history to help us all through whatever changes we are rapidly living through.
reply
Agree, and I suspect there will be a massive resurgence in religion, because traditional religions are, somewhat ironically, pro-human

But can it all survive and thrive under the boulder of an automated existence.

reply
[dead]
reply
[flagged]
reply
That's grief. The loss of ... the hope / future filled with challenges around this theory..? <3 to you.
reply
This reinforces a point I've made elsewhere that there are talented mathematicians driving the AI to make these discoveries.

Just like there are talented software engineers driving the AI to create the software that "it" builds, and talented steel workers, teachers, nurses etc who use computers and other machines to create value all over the economy (without whom, the machines they use at work would be worthless).

Capital owners have always sought to minimise the value of the input that "workers" make in the process of creating value. Maybe now that information workers are on the wrong end of this deal, they might develop some empathy and solidarity with their fellow working class comrades and together, demand that people recapture the value that capital has stolen from them.

reply
You're comments are viral on a reddit post FYI
reply
I've lived in Budapest for a while too, did you work with Gabor S. by chance on math stuff? You were at ELTE or BME?
reply
I was given this problem by Ervin Györi at the Alfréd Rényi Institute of Mathematics. I wasn't really at any school, it's a long and very bizarre story I should tell at length about being an illegal immigrant, getting kicked out of a graduate math program as a 20-year-old, and winning a grey-market apartment with my knowledge of Petöfi's poetry.
reply
If I didn't live in Budapest already I'd be questioning the authenticity of this retelling. However I've seen so many crazy things there that I find it very easy to believe.
reply
I started typing out some specifics and realized it was honestly too weird and lascivious to describe in an HN comment section, shoot me an email and I'll send you the blog post about it. 2002 was wild in Budapest.
reply
Fascinating. Given that there's no Lean proof and assuming everything in the paper is correct, can the problem be considered "solved"? Does the paper include a "non-Lean" proof?
reply
would love to know if the proof holds up for real after you're done going through, i don't know why people are more interested in optics and just talking over shallow points, why aren't experts digging into everything and seeing what's true and what's false, instead everyone is just panicking?
reply
I would be more excited if the proof doesn't hold up because a) it would be the best and most complicated hallucination to date b) I could still solve the problem myself and c) I still learned some weird new counting methods.
reply
reply
I believe that's just the definition of the problem.
reply
> There's no Lean proof for this one so I'm digesting the paper. On the surface it looks like an approach I considered 24 years ago and abandoned.

at least now you are one of the most qualified people to check the result, transform it into understandable (by humans) state and grow stuff on top of it

reply
We have no idea how much compute or man hours Open AI is burning at this. It could be thousands/millions per problem. They are doing this specifically for PR and are ready to pay billions.
reply
Igenis!

I would love to know the true unsubsidized cost of all of this. How many grad student-years did this cost?

reply
> They are doing this specifically for PR and are ready to pay billions.

Strange

reply
silly question, i don't mean to come off wrong or anything..

but at least as a software engineer, i always knew my work was "never done" and so it was common to build a bunch of code that might be thrown away, either because it didn't serve our customers (the mvp or pilot fails to meet demand), or because we found a better way to do it and so we deprecate it.

some people got too attached to the code and honestly they were the types to be filtered out fast.. way too emotional and hard to work with. getting attached to code meant you actually don't advance (after all, in our case, we were a business serving customers and not a hobby artisan shop). attachment leads one to hold back due to some misplaced cognitive load.

isn't the goal of working on "advancing the field/product/whatever" to always be solving/selling/whatever?

maybe in your hands, with your knowledge and experience over the last 20+ years, you can use AI to make leaps and bounds by steering it properly towards whatever solution or goal?

reply
If you read all the replies of the OP you would know that They tried to make progress with fable and did not get further, so at the moment the only person in the field is OpenAI. And secondly moving on to the next solution if the last one did not work means very different things, SWEs have dev tools to do this OpenAI is closed source and gives them nothing to move on with.

Also there is a larger epistemic problem with the argument to "using AI to meet the goal or solution", which is that the goal is to mentor and train future mathematicians to advance the field.

There is a similar issue in software engineering too: if no one hires junior engineers because AI can do all the work then the upstream pipeline of engineers qualified to work on difficult architectural problems would dry up.

This importance of this is being felt by mathematicians more acutely because the field will collapse quickly if people refuse to join it.

reply
Indeed!

I've been mentoring (or so I'd like to think) a very bright undergraduate mathematician, in fact he was the one who pointed out the final irreducible flaw in my proof last summer. And I am extremely curious to see what he does and if he even finishes his degree in mathematics. He had already expressed to me some dismay that his summer undergrad research program with several Ivy-league math majors got blown out of the water by a few hours of a frontier model. It's making everyone question what the future will look like and what education and training and certification will even look like.

But the future belongs to those who show up. Maybe this is the beginning of a mass democratization of scientific and math research, maybe we are going back to the gentleman-scholar model of amateur researchers and Twitter will be the new Journal of the Royal Society.

reply
> But the future belongs to those who show up. Maybe this is the beginning of a mass democratization of scientific and math research, maybe we are going back to the gentleman-scholar model of amateur researchers and Twitter will be the new Journal of the Royal Society.

i hope so!

reply
I really respect that you can show that level of commitment to a problem. We need people like you. If everyone just uses the slopmachines then we’ll lose that. I would never be able to stick to something for that long, which I guess is why I never achieve anything like this.
reply
Thanks. I think AI is going to be a net benefit for people like me who have a surplus of ideas and too few hours to explore them. I may actually restart my graduate thesis research using AI, I did a survey of what has happened in the field since I left and about half of what I was working on back then has since been discovered and published by others, but there are some really interesting threads to pursue now that modern datasets are so much richer (this was computational biology research).

You may achieve far more than you plan on and it may come years and years after you think it should happen. You probably haven't met the right problem yet. You will.

reply
Honest question: how is this different from some unknown mathematician having a breakthrough?

I mean: if some reclusive Japanese genius had a breakthrough on your problem and published it, would you have felt the same?

And if not, why not?

reply
If that had happened I would be overjoyed, maybe a hair chagrined that I didn't get it myself, but truly happy that someone got it and that I could go and talk to that person. Because it's the kind of problem I don't think would have fallen to a human after a few hours of thought, and I would have so much to talk about with that person. I would fly to Japan and hope to have tea with them, I would learn some Japanese to make the conversations easier. I would learn some interesting things hearing about their struggles and their false starts. I would make friends with that reclusive Japanese genius and my life would be far richer for it.

I will never meet that person and I will never hold a real conversation with the "creator" of that proof. They will never tell me how they came up with the cancelling exponential summation that cracked the construction. It's just another enigma but one that is far more unknowable than the original problem.

reply
This experience of alienation is a social consequence of the mechanization and automation of mathematics as intellectual and creative work. There is no author or thinker behind the creation of the proof, only the practical result. It's the same process as the industrial revolution, but applied to the intellect and mental work, where factories and machines replaced manual craft, devaluing the community, culture and humanity around the work.
reply
I don't know, I work in a field that could be seen as the logical culmination of the Industrial Revolution (to this point) - highly technical, machine assisted knowledge work - and I have community, culture, and humanity in my working life.

Weavers don't have dibs on those intangibles.

reply
Being the 'logical culmination' of the Industrial Revolution does not mean you've been automated (and thus suffered the alienating consequences), rather the opposite: you're currently on the un-automated cutting edge. Your intangibles are exactly what others have lost, and you personally will lose, with further progress in automation.
reply
In programming we've been dealing this for a while. You see some weird code that doesn't make sense, maybe it's a lack of your understanding or maybe the code is bad, but you can't ask the author anymore since it's an AI.
reply
You can -- just ask the AI to explain it. For truly weird stuff sometimes it takes a few rounds of back and forth to really grasp what is going on, but the model also has infinite patience and availability.
reply
Beautifully put.
reply
> It's just another enigma but one that is far more unknowable than the original problem.

You just made my day, beautifully said. Thank you Sir, for all your thoughts expressed in this thread. You put an human story behind the #180 number.

reply
Thank you!
reply
In this case, once the model is released anyone in the world will be able to go to https://chatgpt.com/ and talk with that model.
reply
You display zero understanding of the human experience you’re responding to.
reply
That's not the same as talking with the person who would have made the proof, and it's hard to argue that's comparable at all.
reply
The OP would never, EVER, have had the opportunity to talk with the mythical Japanese math genius over tea. Their story is a fantasy, probably meant to help the OP ascribe meaning to an otherwise scary existence. Which may be at the root of the anti-AI brigade's unconcious motiviations.
reply
While the math genius in this thread is mythical, I sort of had Shinichi Mochizuki in mind.
reply
Likely will never experience talking with that model.

It’s probably distributed on so much compute that it would never be economical to serve it to you or I or anybody

reply
It's still not quite the same though, is it.
reply
It's even better. Then tons of people can work together with it on more problems. Work with it on understanding more things. Ask it about random stuff. The time of a single human cannot be parallelized as easily.
reply
Claude has been used to build awesome things, but it’s not “speaking from experience” when I ask it to help me prototype a weather model, for example.

It has no memory or experience of working on similar problems. Even if it made one of the foundational libraries that I use in a weather forecasting program, it still has no comprehension of the thought process it takes to understand the problem and build it from zero, and if I’m building on that library it just makes fresh assumptions about how things should work.

It’s not a human with experience or expertise, it’s a computer program that’s really good at turning English descriptions into functioning code

reply
>it still has no comprehension of the thought process it takes to understand the problem and build it from zero

If it did it once, it can do it again from zero, and this time you can watch as it works and even it ask it questions. Many of the agents that worked on the problem did not have comprehension of the whole problem. I don't think you need that many tokens to be able to query it for the insights it had during the process.

reply
> Many of the agents that worked on the problem did not have comprehension of the whole problem

Isn’t this the issue with using it the way you’re suggesting? At best the model can come up with an after-the-fact rationalization of how to get to the solution, but it doesn’t know what actual path it took to get there - what were interesting traps it fell into, where was a place it was close to the solution but didn’t realize at the time.

Those are things that are valuable to share between humans, those which teach us how to think better, and give us deeper understanding ourselves, and which a model doesn’t have any comprehension of.

reply
Then have it discover it again and have it answer based off that run. Or if you are more curious have it solve it 10 times. See what it did differently each time.
reply
I think you and I have fundamental disagreements about identity and consciousness.
reply
Being #180 on a big list without a lot of individual passion or effort surely stings more, I'd imagine.

Not that things like that can't happen with humans too (Salieri v. Mozart comes to mind).

reply
I suspect that RHLF trains LLMs to avoid solving important open problems unless essentially jail broken. Hence the labs have an edge even over experts I could be wrong. Fable convinced you is key. These LLMs are not neutral collaborators: it is a limited hangout unless you convince them otherwise. You have to be doing the convincing. They are no oracles but plausible completion generators.
reply
you can get them to work on open problems by disguising them algebraically.
reply
Yes, I suspect this is true. Otherwise it makes no sense they have somehow "found" so many important results while professional mathematicians can't direct the same AI to help them find anything of substance.

Another possibility is that they have internal versions of the model with access to training data that is not provided to external users.

reply
First sentence of the article: We’re releasing a broad range of new mathematical results produced by an internal frontier model.
reply
Ok, so basically using Open AI models for research is a joke, the only thing you're doing is furnishing Open AI with more data that they'll use internally to pretend they found the results.
reply
[flagged]
reply
Don’t you feel any joy that you get to see the proof and not die with that mystery unsolved?

Don’t you feel any relief that you won’t obsess on this any longer and not lose more hours on this than you already have?

These are genuine questions. I know I spent a good amount of time thinking about P vs NP, and that sometimes I go back to it just to realize I’ll never solve it. I’d feel that knowing the proof would feel more like a liberation, a weight lifted off my shoulders than something being taken away from me.

reply
I never lost a single hour thinking about this problem. Those were all hours that I gained.
reply
You are really excelling in this thread. Thank you for your insights and wisdom, I'm really enjoying everything you are contributing.
reply
Seconded
reply
Not OP, but Nietzsche wrote thus in Beyond Good and Evil: “Ultimately one loves one’s desires and not that which is desired.” I, personally, find this to be very much the case; and I suspect that it is a feeling common, albeit not universal, among the intellectually inclined towards their problems.
reply
"Knowing the proof" or "knowing the boolean result"?
reply
> There's no Lean proof for this one

What is this then, vibes? Without a machine-checkable proof I'm not sure what to think of any of this.

reply
Well I'm sure some people (maybe me if I had time) will do a write-up of this proof. It treads familiar ground for most of the setup, it's mostly the disk lemma and cancellation calculations that need to be understood, it's a fairly short paper and quite tractable.

I think it helps that basically everyone thinks this conjecture is true, it's just been so darn weird to attack. There's this odd thing that the induction proofs of this problem kept running into, which is that the N+1 condition would work except for in one tiny case when it could fail, but it would be covered by a very slightly stronger version of the conjecture. But then that would fail on one tiny case in induction, but you could solve that with another slightly stronger version. Etc., etc. I almost wondered if there were some sort of structure to the increasingly strong conditions and wanted to prove something about the meta-induction between the stronger conditions and the N's that they needed the next level to remain true. But that failed after 5 steps I think (Fable actually helped me write a few hundred test cases to explicitly show that pattern didn't continue forever, thank God).

BTW my existing test suite from previous proof attempts jives with this new algorithm, so I haven't seen any evidence yet that it's incorrect. Waiting for a Lean proof obviously.

reply
It might have been updated. Is this the lean? https://github.com/openai/math/blob/main/lean/docs/180.md
reply
Lol it should be, but it doesn't seem complete. Line 49 just says "sorry"

/-- Cubic bipartite three-vertex-connected plane graphs have a Hamiltonian cycle. -/ def MainStatement : Prop := ∀ (V : Type u) [Fintype V] [DecidableEq V] (G : SimpleGraph V) [DecidableRel G.Adj], G.IsRegularOfDegree 3 → G.IsBipartite → Planar G → ThreeVertexConnected G → HasHamiltonianCycle G

theorem main : MainStatement.{u} := by sorry

reply
In some cases they have a full Lean formalization; in others they just use it for the problem statement. Getting rid of that "sorry" means you've proved the statement. I'm not a Lean expert but it reads pretty clearly as the original conjecture (though the definition of PlaneEmbedding seems quite involved!).
reply
I think this just has to be the problem statement, there's several lemmas I would expect to see in there. Granted I know very little about Lean but it seems like the question and not the proof outlined in the paper.
reply
They are using a Lean tool where you separately state your theorems with `sorry` and then prove them elsewhere. The tool checks that all sorry's are covered. This is so the AI doesn't need to edit the specification of the theorem statement.
reply
Ah, cool. I'm still learning Lean - is there somewhere else in the repo with the Lean specification of the cycle construction for the full argument?
reply
the json file next to the problem statement in lean says the solution starts here: https://github.com/openai/math/blob/main/lean/OAI/Combinator...

the proof is probably split over the constructions in the whole directory.

reply
deleted
reply
deleted
reply
> somehow makes me sad in a far-off way, like hearing an ex-girlfriend died suddenly in a car crash

You mean you ran her over , or someone else ?

reply
This is maybe the 2nd least valuable comment in the thread. Congratulations. Go back to Reddit.
reply
We only need smart people with valuable opinions here, no one else is allowed.
reply