Missed the memo. Whats the proof of positive free cash flow?

OpenAI and Anthropic have more compute and the best frontier models to throw at the optimization problems. They have published articles on these efforts. For example, Dots, and Anthropic's upcoming "persistent agent" is because of these optimizations. Both companies often publish articles detailing a lot of their technical efforts. They just get buried among the flood of other news.

Yes, I would not be shocked either.

Sonnet 5.5 is 16x more expensive at $10 per million output tokens. Kimi K3.1 is also $10 per million output tokens, and its number of active parameters is only 6.5x larger than V4.1 Flash (104B compared to 16B). These things are not directly comparable of course, but just to give an idea.

Even if inference of those models needs 16x, 32x, or 48x the number of GPUs compared to V4.1 Flash, still seems like potentially great revenue per GPU.

They published all/most of their work and it would be unbelievable if Anthropic had not already used that research in their own architecture.

What is the TPS of DeepSeek? All of the LLMs I have tried are slow as molasses. \

> its per GPU-cluster, not a single gpu.

No, it isn't. It's revenue per hour per GPU.

Based on translating their Chinese text on Firefox, it says "per card":

> The current service throughput of a single cluster is 155 trillion tokens per day, and the overall revenue is $38 per hour (at the lowest price) per card.

With Kagi translate (best), it says GPU

> A single cluster currently serves 155 trillion tokens per day, generating overall revenue of $38 per GPU per hour (at off-peak electricity rates).

https://zhuanlan.zhihu.com/p/2095560295930508953