Companies are going pretty quiet about costs, but I see no reason to believe the cost to train a model exceeds $5B. Moonshot AI's entire funding is like $5B, their $300M revenue is negligible but not nothing. Renting the compute to train a model like Kimi K3 cannot possibly exceed $5B and is probably under $1B. It's probably at least $100M, but also plausibly not. I don't think it's likely Meta would be giving away models for free if the compute cost to train them was in the billions. This 30B parameter is tiny, that's not billions of dollars, that's likely millions, maybe even less.