upvote
I also thought that, but I learned that most of OpenAI's results in their proof dump did not use theorem provers in the loop. They translated the papers to lean afterward.
reply
But weren’t most of those papers totally unverified? I.e. there’s no reason to believe that the ones without formal verification are actually correct.
reply
If i understand it correctly, lean is very useful for post-training (RL) step of the models.
reply
Right, that's how all these proofs (including a few of mine) are done. Given the large-scale AI efforts already underway to formalize proofs in Lean, there could be some very interesting gains once proofs are Lean-first. For now, though, formalization happens afterward.
reply
I don't expect proofs are going to be lean first. There's a reason they already aren't.
reply
It's not really the provers that are the innovation. They existed before AI. The innovation is that the computer can write the proofs.
reply
It’s the power of feedback loops

Same with gradient descent

reply
Exactly. Another example of how AI depends on software which is carefully, deterministically hand-coded. It's disingenuous for people to say "look, we don't need to code anymore" when all these solutions depend on things that are definately well-thought out and hand coded.
reply
Today.
reply