Given the rate of progress of LLMs, I wouldn't be surprised if we had decent fully open and reproducible models within a decade or so, especially once the current spike in hardware price passes and building a local training cluster will be more realistic.