upvote
Anthropic would have claimed the result for themselves, without Levant, if they could. They didn’t. A strong mathematician was evidently required.

It doesn't make sense to compare the quantity of work. Humans are significantly more efficient than AI, so little work can go a lot further.

I’m sure for every incredible insight which Levant credits to Claude, there’s 100x+ more bad insights that Levant had to filter out.

reply
> I’m sure for every incredible insight which Levant credits to Claude, there’s 100x+ more bad insights that Levant had to filter out.

This is certainly my experience of using Claude every day, in a much less cutting edge domain.

And Claude itself cannot tell the difference between the two. The best it can do is use some sort of external constraint (e.g. verification) to filter them.

reply
Honestly, ever since Opus 5.5 dropped about two months ago, Claude's taste has been great, better than mine, even. Compared to Opus 5, I've barely had to filter anything out by hand.
reply
It is fascinating. Because sometimes my experience is like yours, but other time, like today, I am like “I can’t believe how stupid Opus 5.5 or even Fable 5.2 is”. They will make horrible design decisions, overcomplicating. I will correct and they are like “Of course, your solution is much simpler and better than mine”.

And then they are simply boldly wrong at times. About mathematical facts. That’s why we need formalisation when working with them. They are still stupid and can’t be trusted. But theyvare also smart and can come with amazing insight. It’s a tool, but definitely one which cuts both ways.

reply
I think it's funny that people gauge their personal experiences with AI against something like this.

Do we even know what Alpöge had at his disposal? I think most people underestimate what working with an agent swarm even with the current public technology would be like. We can't assume he didn't have something more advanced either.

I don't feel confident my usage of AI on a personal level reflects any of what has been done here.

reply
Your argument is unfalsifiable speculation. I don't at all that it's self-evident that a strong mathematician was required. Your everyday Joe isn't exactly interested in the Reimann hypothesis so statistically a mathematician would be the one who'd use AI to come up with the solution.
reply
How would a non-mathematician even be able to comprehend the output? Half the words in the pdf are gibberish to me, I could not tell if whatever Claude gave me for a "solve the Reimann hypothesis, make no mistakes" prompt would even make sense, much less be correct.
reply
I don’t know shit about HPC and LLM inference, didn’t stop me from creating an inference engine: https://github.com/computerex/dlgo

A non math person may not be able to comprehend the output, but even professional mathematicians have trouble reading through the huge “alien” AI generated LEAN formalised proofs.

reply
deleted
reply
The real genius is that we have found a generic way of solving problems through brute force by having developed an effective way of aiming an unbelievable amount of computing power at them.
reply
How to brute force 15MLOC to compile is an exercise for the reader.
reply
Reading his post, this is not the impression that I get.
reply
If the genius here is Claude and Claude did 99% of the work then isn't it a staggering coincidence that this was achieved by one of the most qualified and likely humans to have solved this on their own merit and not some random person sat in a bedroom somewhere?
reply
Company selling shovels says shovels did all of the work
reply
Human who could claim credit claims AI did all of the work.
reply
I also use Claude and it never produced this result for me.
reply
Did you also have access to unreleased models by Anthropic?
reply
Doesn't matter; Claude ends up taking cues from whoever it's working with, such that two people doing the same thing get very different outcomes. Claude will always be able to write better software when prompted by a senior engineer; it will always produce better math when prompted by a talented mathemetician.
reply
But also an employee of the shovel company.
reply
Not sure anyone would have been able to write 250k pages of Lean without the shovel
reply
Real men used to be able to fly to moon on 10kb of memory (and 100 billion dollars)
reply
And they weren't able to prove the Riemann hypothesis
reply
But they landed on the moon.
reply
Yet some people are still skeptical about that.

On that topic, I'm surprised the usual anti-ai trolls aren't posting low-effort drive-by "ai slop", "stochastic parrot", "autocomplete on steroids" comments to this very discussion.

Edit: I stand corrected: RunSet, ToucanLoucan, luka598, and others have checked in.

reply