upvote
> I’m sure for every incredible insight which Levant credits to Claude, there’s 100x+ more bad insights that Levant had to filter out.

This is certainly my experience of using Claude every day, in a much less cutting edge domain.

And Claude itself cannot tell the difference between the two. The best it can do is use some sort of external constraint (e.g. verification) to filter them.

reply
Honestly, ever since Opus 5.5 dropped about two months ago, Claude's taste has been great, better than mine, even. Compared to Opus 5, I've barely had to filter anything out by hand.
reply
It is fascinating. Because sometimes my experience is like yours, but other time, like today, I am like “I can’t believe how stupid Opus 5.5 or even Fable 5.2 is”. They will make horrible design decisions, overcomplicating. I will correct and they are like “Of course, your solution is much simpler and better than mine”.

And then they are simply boldly wrong at times. About mathematical facts. That’s why we need formalisation when working with them. They are still stupid and can’t be trusted. But theyvare also smart and can come with amazing insight. It’s a tool, but definitely one which cuts both ways.

reply
I think it's funny that people gauge their personal experiences with AI against something like this.

Do we even know what Alpöge had at his disposal? I think most people underestimate what working with an agent swarm even with the current public technology would be like. We can't assume he didn't have something more advanced either.

I don't feel confident my usage of AI on a personal level reflects any of what has been done here.

reply
Your argument is unfalsifiable speculation. I don't at all that it's self-evident that a strong mathematician was required. Your everyday Joe isn't exactly interested in the Reimann hypothesis so statistically a mathematician would be the one who'd use AI to come up with the solution.
reply
How would a non-mathematician even be able to comprehend the output? Half the words in the pdf are gibberish to me, I could not tell if whatever Claude gave me for a "solve the Reimann hypothesis, make no mistakes" prompt would even make sense, much less be correct.
reply
I don’t know shit about HPC and LLM inference, didn’t stop me from creating an inference engine: https://github.com/computerex/dlgo

A non math person may not be able to comprehend the output, but even professional mathematicians have trouble reading through the huge “alien” AI generated LEAN formalised proofs.

reply
deleted
reply