> We know labs make money on inference
replyWe don't really know that, for OpenAI and Anthropic. We suspect that, but as far as I know, even they have stopped claiming that they are profitable on inference.
unless you think that Opus is 10T+ params, its pretty much impossible for inference not to be profitable when doing some basic napkin math on other open models, and if Kimi K3 is 3T params with the same performance as Opus then that means that China is actually way more technologically advanced than the American labs.
replySo which is it?
Just out of curiosity, based on what we know for sure they(OAI+A) make money on pure inference and lose on inference+training?
replyOpenAI's financials leaked and showed this pretty convincingly.
replyAnthropic was probably profitable last quarter, without training costs: https://www.wsj.com/tech/ai/mind-blowing-growth-is-about-to-...