That might require continuous learning without verifiable rewards. RL models might help humans join the dots faster, but we don't know how many years that will take.
If its not possible with neural nets as we know them now, and requires a number of completely novel breakthroughs, there could be far from exponential progress even with the best RL models.
But it also might not, which is the scary part.