Again, there is a moat based on compute. If the thesis is right, cost of compute will only rise... As it is as you say someone will have it be quite wealthy to host something like Astra with trillions of parameters, but that cost will only rise with demand for serving these frontier models.
replyThat hasn’t been true for anything else in computing, ever. The cost falls with scale.
replyLook at general compute, storage, graphics, networks, anything. Demand increases. Price goes down. There are price spikes, such as right now with RAM, but they’re transient. The trend is more faster cheaper and it won’t end until we hit actual physical limits. We are not close.
what suggests that we will hit an asymptote any time soon? Agree with you on the second part. The ever elusive frontier will probably always be changing hands after some point.
reply