math major here, I can't read the paper for shit
replyNot a math major here. But is this paper way too long? So long that it raises the possibility that OpenAI's staff mathematicians passed through AI's raw output as-is?
replyThat problem seems independent of the 'stochastic parrot' accusation?
replyA parrot might squeak the theory of everything and it won't matter to any of us cause nobody speaks parrot.
replyWe can record a lot of parrot speech and train LLMs against it and eventually build a translator.
replyThey are making good progress on similar research programmes for many cetaceans.
In the case of our stochastic parrots it's even easier, since they already speak something like human language. And for the math proofs it's even easier, because once they are formalised into something like Lean the humans only need to understand the statement of the theorem, and a mechanical computer program can check the proof.
Yes we can just train llms against it and it's all solved. Just a few more trillion dollars and a bunch of deforestation for datacenters bro.
replyIronically yeah.. if it can solve more complex problems across domains like biology, econ, finance then all the deforestation is worth it
reply[dead]
replyIt is just that we never considered how advanced stochastic parrots could be so powerful when dealing with basically the whole library of acquired human knowledge and guided by experts to generate.
replyIt is not a demerit, actually I think that it is a very elegant outcome how many problems could be solved by generation and this probably show us how language is a far more important thing than we ever thought it was.