I think the counterpoint here is simply to look at what was being achieved with LLMs one year ago versus today, and extrapolate that trend. Sure, there may not be examples of what you've asked for yet, but Astra is literally a couple of months old, the model that solved Navier-Stokes is less than two weeks old. It appears that we're seeing the hockey stick that only the most bullish thought was possible.
Also there are proofs where the only human steering was "keep going".
Any result of such kind from an AI alone would be enough to refute my argument, yet you don't present any.
>Also there are proofs where the only human steering was "keep going".
Which ones?
>Throughout this process, Jarred's input was mostly limited to sending Claude messages of encouragement (mostly variants of “keep going” or “believe in yourself”).2 This seems to have helped Claude overcome some initial skepticism that it could make meaningful progress.
> Drawing on extensive prior research by mathematicians over the past decades, it
> [Claude] has increased this bound [for the fraction of zeros of the Riemann zeta
> function that satisfy the Riemann hypothesis] from 41.6% to 67.2%. Claude also
> produced a formally verifiable proof of its result.