upvote
175,187 modules... a lot of them are repetitive.

It really seems he was rushed to publish and did not bother cleaning the code up at all. I am compiling the code and reviewing it, and there are 204 dead modules that are not referenced anywhere. And a LOT of repetitive code.

I think this should not be 17 million lines, I bet this can easily be under 1 million lines of Lean with a little bit of cleanup.

reply
It is probably not that compressible. Anthropic FLT proof also has a lot of redundancies but my projection is without true mathematical refactoring it will be hard to get to 50% reduction in line count. One problem is that Lean, or type theory really, is truly verbose. In these parallely developed proofs if two agents use slightly incompatible definitions there are a lot of translations back and forth. Also FLT is following routes well established by mathematicians and it still got to 13 million lines. So I am actually surprised that GRH is not much bigger, as it reportedly ranges over a wide swath of fields.
reply
Anthropic claims to have a 1/7 the size version somewhere. https://claude.dev/blog/safely-scaling-multi-agent-teams-wit...
reply
Yes it would be interesting to see that version. If compaction comes from proof architectural improvement (what I called "true mathematical refactoring"), it could improve readability. On the other hand if it is tactical, for example using tall rw stacks that are incomprehensible to humans, shortness doesn't necessarily imply better accessibility. I suppose it has to be a lot of the first kind to get that much compression.
reply
Even with all the resources he presumably have… interesting
reply
Hence why it seems rushed. Backed by Anthropic he certainly can clean it, model access or $$$ is probably not a limiting factor; only time.

I don't know if Anthropic IPO being yesterday, or American Mathematical Society Executive Committee and Board of Trustees meeting being today has anything to do with the announcement happening today, but it's certainly interesting timing.

reply
i would imagine the IPO has everything to do with it
reply
Apparently a mostly human/human only unfinished proof on the hypothesis was rushed to publication upon hearing this news. It is around 1000 pages long. I don't know what the approximate ratio should be but fully formal propfs generally are much longer than natural language proofs. So probably this size is ij 5he ballpark of normal. If anyone sho writes lean proofs or works in formalized mathematics can comment that would be nice.
reply
I am very skeptical of that human-only proof.
reply
It more than 250 000 pages.
reply
I am a hobbyist home-server-builder and would love to know more about you and your company. I love hearing cases where you as an employee get direct access to the hardware. can you share any more details? I'm kind of spazzing out right now with how casually you said some wildly awesome stuff.
reply
I probably shouldn't say this, but I work at a company related to CPU manufacturing.

Part of my job is to ensure that HPC programs (largely LLM libraries these days) work on their next-generation CPUs and with new BIOS revisions. We test them using a shared pool of machines with various configurations. GPU machines are much scarcer, and we have to share them with other teams, so it's hard to reserve a time slot. I usually reserve a CPU machine around the clock so I can work whenever I want (I'm more productive at midnight), and nobody seems to mind.

I've worked here for almost a year now, and I love my company ;)

reply
reply
“related”
reply
deleted
reply
480 core xeon kinda hinted at that :D
reply
Thanks for sharing!
reply
Hmm, an unnamed CPU manufacturer using a ton of a specifically named processor. No idea where you could be working, I’m stumped. ;)

Well I guess you did say ‘related to’ manufacturing which widens it a little. :P

reply
That's a fun machine but there's similar (or even bigger) configs on AWS - https://aws.amazon.com/ec2/instance-types/u7i/

Expensive, but you can just try things!

reply
Roughly what would the above cost?
reply
u7i-6tb.112xlarge

$62.79/hr

https://aws.amazon.com/ec2/pricing/on-demand/

I run many high core jobs for various reasons, I often reach for many smaller machines rather than one enormous node like this. But not familiar with how lean parallelizes.

reply
Jane str
reply
Any company which self hosts in a data center has employees accessing to hardware. Every company I've worked at was on-prem. Why is this treated as an outlier? Is everyone on AWS these days?
reply
No need to be snarky... having access to HPC clusters has little to do with "on-prem VS cloud" and is certainly an outlier in the prevalent SaaS world.
reply
Not snark, I was just surprised. No need to be cynical. If we are talking about HPC clusters specifically, then of course I agree.
reply
I have no idea what I'm talking about, but is it possible the lean program itself is wrong and in fact it proves something different?
reply
It's possible, but the probability of it being wrong is much lower than a peer reviewed human paper being incorrect.
reply
Most of the OpenAI proofs from the last big dump that have been looked at with some time don't actually match the lean claim now the media circus has moved on so I think the industry earned their lack of benefit of the doubt for a lot of people.
reply
Those doubts are misplaced then. The natural language proofs have problems, sure. But that has no bearing on the correctness of Lean certificates.
reply
Does Lean compilation usefully parallelize over that many cores? That’s a mini miracle by itself!
reply
Yes but only for independent parts of the process. Having all of these modules helps quite a bit with that.

It really is quite slow, I've been having my dot and its 6 sub astras churn away at a proof for Z is Diophantine in Q, even 1/10th as many modules is an overnight affair on my 5800x3d with 128gb of ram. The first version I started on was 326 or 318 variables, but it's allegedly also found some in the mid 100s.

I've been having chat make a neat graph of the spam, it's neat to watch grow (hit the replay button) https://quartic-park.sneakyness.chatgpt.site

There's no real definitive measure of progress, all of the foundational stuff is handled and now it's working on the tricky stuff that is assumed away in the original that made me decide to let them loose trying to formalize.

reply
Did you try #print axioms?
reply
Thanks for that. Could you have an AI summarize the 460k linter warnings and decide if any of them are significant? Also, how much RAM was in the machine, please.
reply
The machine itself has 1.5 TiB of memory; I did not check the free memory while it was running, sorry :(

LLM-generated text below: ``` The build printed about 460,000 linter warnings, and none of them affect correctness. Almost all are code-quality issues such as redundant proof steps, style, and unused variables. About 33,000 are uses of deprecated Mathlib names, which only matter if we upgrade Mathlib.

Memory per process wasn't logged during the run. The container's lifetime memory peak is 441 GiB, but that includes file cache and is only an upper bound. A typical module uses about 0.5 GB of its own memory, and the heaviest use about 8 GB. With about 280 compiles running in parallel, the build used at most about 215 GB of the machine's 1.5 TB of memory, based on spot checks. ```

reply
Thank you!
reply