They’re growing over 10x a year. They want users and revenue. In order to get users and revenue, they want to provide the smartest models at affordable prices. If they unnecessarily burn tokens, users will get less value and switch.
This thread is filled with competing comments about their monopolistic power and how when one model provider was no longer doing a good job people switched to a different one.
The competition in this market is ferocious!
I see posts all the time on HN about which models from which providers offer the most bang-for-the-buck, and how to minimize token usage and still get optimal results, so it appears that competition is working.
1. Self hosting
2. Chinese models
3. Running it locally. Requires upfront cost and compromises on TPS.
Hell, I use 3 different providers, and I currently don't give a dime to Anthropic or OpenAI.