Anthropic/OpenAI really need to train ever-bigger models to keep their moat. But that assumes there isn't a law of diminishing returns and also that a compressed model isn't sufficient for what many people need.
You mihgt say that the training is a barrier. And it is, kind of. Notice how it's Chinese companies coming out with open-source models like DeepSeek and Qwen? That's no accident. As soon as DeepSeek came out I knew what was going on: China is going to make sure no single Western company "owns" AI. It's in their national interest for that not to happen.
I wouldn't be surprised if the rush-to-IPO is motivated, at least in part, by getting ahead of Chinese AI commoditization.
If Ant, OAI, etc. aren't able to make 20-30% improvements on Opus 4.6 in 2026, does the music stop playing altogether? It seems like they'd lose their ability to charge >10% gross margin on inference in a span of 3-6 months.