> At present, some frontier AI labs are testing advanced mathematical problems on proprietary models that remain inaccessible to the broader scientific community. Our recommendations are formulated with this practical context in mind. However, ideally, they would not do so. We want to state clearly from the start: we do not endorse this practice, and we ask them to stop testing advanced mathematical problems on proprietary models.
To me, the issue is that the models are proprietary which are only accessible to a few people in 2 digits. It's not about progress but access.
They won’t because they don’t care and the only way it got this good is something along the lines of they trained on every mathematician’s codex sessions even if they opted out because they consider the thinking traces or output and metadata fair game.
These models are too expensive for broad access unfortunately.
This is sort of like discounting putting humans in space because only a few nations have the means to actually do it at the moment.
It's been a while since I was reminded of this xkcd: https://xkcd.com/435/
How this maps back to math, idk.
> "I believe that AI can contribute positively in all of these directions [NB: exposition, community building, new directions of study]"