Because they have too many free users that will always remain on the free plan, as they are the "default" LLM for people who don't care much, and that is a enormous cost. Also the capabilities of their paid tiers are well known to enough people that they can rely on word of mouth and don't need to demo to customers-to-be
replyThey're not more default than people innocently googling something and getting an AI response from some form of Gemini.
replyRight, but that form of Gemini is also not the top Gemini model with high thinking budget that you would get to use with a subscription, the response is probably generate with Gemini Flash and low thinking.
replyIt's all trade offs. The router works most of the time so most free users get the expensive model when necessary.
replyThey lost x% of customers and cut costs by y%. I bet y is lots bigger than x.
Through hype. I am really into this new LLM stuff but the companies around this tech suck. Their current strategy is essentially media blitz, reminds me of the advertising of coca cola rather than a Apple IIe.
replyThe good news for them is that all their competitors have the exact same issue, and it's unsolvable.
replyAnd to an extent holds for lots of SaaS products, even non-AI.