upvote
This result is some evidence that AI will not solve RH soon. If there were any easy solution hiding in plain sight then it probably would have found it.

Solving RH likely requires AI that is substantially more creative. But we haven't even solved the creativity problem for writing let alone mathematics. I believe that transformers are a trillion dollar local optimum that we will find it very hard to escape.

Let's wait for the models to produce a good novel first.

reply
I would expect to see LLMs that are creative in math before any that are creative in writing. Creativity is more easily specified in math and the solutions can be formally verified. There's no good way to classify creative writing. Many truly great works are overlooked by experts and the public until decades later. Many derivative works are commercially successful.
reply
LLMs, both in writing and mathematics seem to only be capable of coming up with texts that are inside the distribution of the training data.

With writing it's just more obvious. LLMs don't write with personality. They don't create new and exciting worlds on their own. Everything they output feels derivative.

In mathematics you see the same effect. They are very good at finding results that humans missed, taking advantage of their broad knowledge and tireless work ethic.

But just as they have been unable to create new literary worlds, they also have so far been unable to create new mathematics.

I believe this lack of creativity is intrinsic to how these models are architected and trained. We want models that produce these in-distribution outputs because those types of models are more economically valuable. Nobody wants a coding agent with spontaneity, we want models that predictably and obediently solve problems - and that's what we got.

reply
deleted
reply
> This result is some evidence that AI will not solve RH soon. If there were any easy solution hiding in plain sight then it probably would have found it.

There's no way you can conclude that. Yes, "Fable 2" or whatever this was probably won't. But we can't know what Fable 3/4/5/etc will be able to do.

If anything, if we have 1 or 2 more years of progress like the last 12 months, which have been insane, I'd say LLMs are likely to solve it.

reply
You underestimate the difficulty of RH, there are far easier problems broadly related to RH (density hypothesis, Artin's holomorphy conjecture, Stark conjectures) which are still aren't solved.
reply
I think verifiable tasks like math will soon be like Chess. Machines way beyond human intelligence.
reply
As it stands now, the frontier models can prove theorems where the techniques exist in the literature, which it knows better than anyone who's ever lived and won't quit where a human would. There's no way to know if that's true of the Riemann Hypothesis until it's proven.

For example, even if Claude could prove the statement "100% of the zeroes lie on the critical line", that's strictly weaker than the Riemann Hypothesis, so even the best possible version of this result would fall short. (It's an asymptotic result, so it just means the percentage of counterexamples to the Riemann hypothesis goes to zero as their magnitude gets large.)

reply
Let's extend this by asking: If an AI model can solve an extremely well known Math problem which has been open for centuries but hasn't be solved by a human mathematicians, why wouldn't that same model be able to find ways to improve it's own algorithms beyond that of the capabilities of human mathematicians / ML researchers?

The singularity is approaching.

reply
AI has clearly been extensively used to improve models. The evidence for this is how far Anthropic went in nerfing Fable to prevent it being used to improve models.
reply
> The singularity is approaching.

There have been apocalyptic preachers foretelling the end times for my entire life. Interesting to see how the language has changed, even as the predictions fail again and again.

reply
This argument also proves that climate change and nuclear war aren't possible existential issues.
reply
I believe it's already well accepted in these labs that we're in the Singularity. It happened on a Tuesday back in February. No one seemed to really notice and life went on... for now.
reply
That's probably correct. It's unlikely there will be any single hard line we cross the defines the pre-singularity vs post-singularity moment.

I'd accept AI likely became somewhat helpful to frontier AI research & development in early 2026.

I think for me though the real game changer moment will be when AI working autonomously is able to hypothesis and test algorithmic improvements at a faster rate than humans. This will be done to some extent by scale – lots of parallel agents coming up with lots of hypotheses and running the best candidates as tests. But also (and perhaps more importantly) by making more consequential algorithmic discoveries in the field of machine learning than humans – a bar we appear to have crossed or are crossing with math.

I suspect AIs today are super-human at finding performance improvements and minor iterations on current approaches. Whether they can solve some of the larger algorithmic challenges in the field however I'm not yet sure, although it seems likely that unreleased models are starting to make progress here.

An algorithm breakthrough on par in significance with the attention mechanism, primarily driven by automated AI research in say a field like continual learning would in my opinion be extremely significant and should leave no doubters that the singularity is here and will rapidly alter the world as we have known it.

reply
the AI model has NOT solved Riemann
reply
I feel you. I am trying to remain positive too.
reply
>why wouldn't that same model be able to find ways to improve it's own algorithms beyond that of the capabilities of human mathematicians / ML researchers

Because algorithms have lower bounds, and the computational characteristics of LLMs are well-characterized by papers like https://arxiv.org/abs/2310.07923 . No amount of intelligence can make something faster than a mathematically-proven lower bound, any more than it could make 1+1=3 (that's why every single successful production transformer architecture has some form of O(N^2) attention layers, because it's mathematically impossible to achieve the same expressive power without any). There is room for speedup where current implementations are slower than the proven lower bound, but not when they're already close to it.

reply
> There is room for speedup where current implementations are slower than the proven lower bound, but not when they're already close to it.

Sure, but I'm obviously not limiting research to improvements on current approaches only.

We know the brain is far more energy efficient and sample efficient than current AI. There is clearly better algorithms out there.

The question is who will find those next big algorithmic improvements like the transformer architecture? Will it be AI or humans?

My bet would be AI.

reply