Eg: https://www.reuters.com/technology/bytedance-targets-mega-ai...
That reports Mythos as 8T and Fable as 5T, but I think they mean Opus as 5T, which is widely known, eg: https://eu.36kr.com/en/p/3760679047267075?ref=explainx
Both Grok and Bytedance are training 10T models.
Honestly if Opus is 5T parameters while being matched by the biggest open models that are at least twice smaller, it would mean that the US is already behind China in the AI race, despite a significant edge in compute.
For example I regularly do Fable+Opus agentic coding runs over 24 hours without intervention.
I think I've had GLM do a run that was a few hours. That's the closest I've had an open model come on that kind of work.
This assumption is likely what has led to the erroneous failure.
Enterprise compute per rack has scaled multiple fold in the last 3-5 years. Alongside the training efficiency gains & datacenter scale increases, even 50T+ is well within reach at the top end.