Are you trolling? OpenAI's models resolved the Cycle Double Conjecture yesterday, which has been an open problem for 50 years.
replyDo you even know what Cycle Double Conjecture is? Or what even a conjecture means in general? It’s a perfect use case for autocomplete with existing knowledge
replyOne of the lead authors, Daniel Kokotajlo, worked at OpenAI for years before quitting. In 2021 he wrote a remarkably accurate forecast of how LLMs would develop over the following 5 years[0].
replyI think it should be obvious that he understands that LLMs are trained via next-token prediction.
[0]: https://www.lesswrong.com/posts/6Xgy6CAf2jqHhynHL/what-2026-...