compute and amount of training data built on top of XXX B investments is very strong barrier.
If we can extrapolate from that (I don't know if we can), good enough models might be achievable with much less than XXX B investments.
I think it's much more like cloud, where sure, there aren't any single barriers to buying some servers, putting K8s on it, having an account management/billing system...but in practice the expertise in aggregate to run a profitable one is quite rare.