2 years these charlatans have had their "imminent collapse" predictions repeatedly wrong, meanwhile all valuations, AGI progress in unsolved problems, and frontier leadership have been repeatedly vindicated that we are beginning ASI / the singularity.
His predictions (while often wrong) are at least somewhat justified and backed up by genuine scoops and original research. Altman goes on podcasts and talks about building Dyson spheres for energy.
Open weights will drop costs, but distribution matters. OpenAI has that.
Costs will come down. Deep entrenchment will not.
Each generation of model is more expensive to train and run than the last.
More efficient hardware? That means throwing out billions of dollars worth of existing hardware and buying billions more in hardware. The cheapest hardware is the stuff they already have because spending $70B in hardware to halve a $2-4B electricity bill just doesn’t make financial sense (and that’s if doubling hardware efficiency can happen before they go under).
If they cut costs by using smaller models, they are then racing to the bottom vs China which seems hard to do (especially with China’s cheap solar energy).