upvote
The fact that he happily used AI in his efforts for this problem makes this seem strange.

It would be like feeling bad for an incredible chess player, using a chess engine, losing to an incompetent chess player using a better chess engine.

reply
> I feel bad for Buckmaster and Alpoge.

I don't, at all. In fact, and this may be controversial, I kinda like the OpenAI approach of crediting the model, and not an author. The model did the vast majority of the work.

I feel bad for folks like Kevin Buzzard, doing the FLT Lean formalization by hand on a grant and then watching AI blow past it.

I also feel bad for the young people entering the field in such "interesting" times.

This is mostly OpenAI and Anthropic racing each other with a nearly unlimited token budget, hard to feel sympathy for that.

reply
In the OpenAI case, it was 100% the model solving the problem. This and the RH solution were more collaborative efforts, so I'm fine crediting the humans partly there.
reply
Good point. I would love to look at session transcripts and see what steering the RH/NS solutions looked like. Whether if it was getting the model unstuck or encouraging it to explore in directions they thought would be fruitful.
reply
>The model did the vast majority of the work.

Yea? What does that mean exactly?

reply
i don't think that people are wrong to use the words "brute force" to describe the models - swarms of computers - writing 10,000 proposals for Lean proofs, implementing them all, and seeing which compile and continuing until some advancement of the solution, a 1,000,000:1 ratio of work : moving towards the goal, as the superhuman step needed to finish these proofs. Most forces in our world are superhuman.
reply
> The model did the vast majority of the work

Unless it just regurgitated the ideas that were fed into the training data by the human. We might be at or near the point where the models won't depend on that anymore, but in this particular case I think we shouldn't discount this possibility. Even OpenAI hasn't ruled it out afaik.

reply
OpenAI did categorically rule it out some days (weeks?) later, but the optics damage was done. I tend to believe them purely because they’ve released 100s of other proofs since.
reply
In the announcements I've seen, OpenAI categorically ruled out giving the model access to user chat sessions. They explicitly did not address the possibility of chats ending up in training sets, and did not answer an explicit question by Tristan Buckmaster. Why would you think those other proofs wouldn't be inspired by the ideas that thousands of mathematicians worldwide had discussed in their chats?
reply
They did later rule out that his codex sessions ended up in training data.

https://openai.com/index/navier-stokes-solution/

reply
Being able to regurgitate basically all of number theory into a proof like this is new.
reply
Navier-Stokes has very little to do with number theory, by my very limited knowledge. You might be confusing this with the Riemann Hypothesis proof that was also published today, by Anthropic. The days we live in...
reply
>I kinda like the OpenAI approach of crediting the model

And who does the model assign credit to? It'd be interesting to see when all these proofs are cleaned up and understood by humans, how much actual innovation in information terms was added by the model and how much of it was its sheer bandwidth to correlate wildly disparate fields of mathematics to come up with proofs of conjectures (i.e., working within an entirely closed system). Don't get me wrong - forming those connections across those fields is impressive and useful in its own right.

But if there is no "innovation", then we are still in Ford's "faster horse" regime, not true intelligence.

reply
It is controversial largely because it falls into the prior context of OpenAI's marketing strategy of being rude to humans. It's hard to tell from outside if this is oblivious or someone's genius strategy to drum up a sense of despair/inevitability for the machine ascendancy.

'Ghiblify' was the epitome, where a marketing demo was deliberately framed to be rude to talented human artists, for no business-sensible reason. The style-transfer was played around with for a few months and then died out as a generally cringe thing to do. Of course, OpenAI's future isn't affected by a bunch of people with pencils in Japan who are liked for practicing a deliberately low-tech craft. On the other hand, OpenAI has not yet made an animated movie.

Now, applying 'ghiblify' dynamics to interactions with scientists, which might be kind of important... the rumour is that OpenAI people talk to scientists, hear something they don't like, and start saying "we should just ask ChatGPT".

The natural counterpoint will be scientists getting contacted by OpenAI for help with something and replying (in more polite terms) "why are you bothering to talk to us if you think we're obsolete? Just ask your AI :)"

reply
Science during idiocracy: Confusing the shoulders of giants with a glorified chatbot.
reply
I don't think you should get credit for your comment.

Really, all the technologies that went into disseminating your comment did it: telecommunications, the PC revolution, the internet, etc. etc.

reply
Perfect credit assignment is harder to solve than Navier Stokes
reply
No, academics already have a great attribution system. Tech companies just don't want to use it.
reply
IDK, it feels like “climbing” K1 then deciding to take the helicopter and call it a win. Nothing wrong with helicopters, it’s just not the same race. First, all will question your ability and, second you have to ask what could have everyone else tackling the same problems could have achieved in a similar manner.
reply
deleted
reply
its more like manual agriculture vs agriculture with a tractor
reply
The difference is that a proof is true or not independently of the human sphere. It’s not an endeavor like “get to the top of that elevation, but only use your legs so you can demonstrate your mental fortitude”.

The race hasn’t changed, people are now retroactively pretending that the race was always about something other than it was commonly understood to be, because they don’t like that machines are beating them at it.

reply
This is not at all historically accurate. The purpose of mathematics was always understanding. As far back as the computer proof of the four-color theorem, people have largely felt that "having a proof" wasn't as good as understanding why something is true. We still basically don't know why the four-color theorem is true, other than the fact that you can rule out the 600+ minimal counterexamples.
reply
> people are now retroactively pretending that the race was always about something other than it was commonly understood to be, because they don’t like that machines are beating them at it.

I think this is uncharitable.

It is true that a math paper is useful to the world regardless of whether it was authored by human or machine.

It is also true that people have a deep-seated need to feel esteemed and valued by their community. Many people derive that from their profession and many mathematicians derive it from being able to manipulate symbols in their head in a way few others can to discover truths about the world.

It is cruel to watch that meaning get ripped away and shrug simply because the same math papers are coming out in the end anyway.

reply
I see the platonic angle, but the proof being true is less of a concern from a "race" perspective. It's just saying that there's a K2 peak, vs climbing it and vs climbing it for the first time.

Obviously there are more aspects here:

- is a conjecture true or false - this has utility on its own

- finding a proof - this is an ability game/race - this used to be a part of math, but I'm arguing at this point this got muddy unfortunately

- finally, is there utility (other than personal desire to understand) in having people do math

Surely, just like we don't mix F1 cars with Usain Bolt, we can still have IMO.

reply
Maybe consider that some of these people are not up in their own ass about their ego, and consider it more meaningful in life to have solutions to these problems than it it so write their names in blood on new discoveries for clout
reply
Alpoge will have to be satisfied with merely solving the most important problem in all of mathematics.
reply
He should have a chat with Grigori Perelman, about ending up with exactly this result:

https://m.youtube.com/watch?v=xTTJycPohNg

reply
Why? This is precisely the kind of “your wish is granted, but you will regret it” outcome that is expected from a magical genie.
reply