What's interesting is that scaling appears to continue to pay off. Gwern was right - as always.

It seems inevitable that costs will come down over time. Expensive models today will be cheap models in a few years.