Forget about their pricing but the companies that do have means to host such models fully on-prem are also the same companies that are paying tens of millions of $ in inference cost every month, and are by extension the biggest customers of OAI and Anthropic
After using it for a few hours, I believe these benchmarks.
I don't want to cheer against my country, but we've given up on open source. The way Anthropic and OpenAI treat their customers as adversaries is embarrassing.
I will cheer for China, for Kimi, and for z.ai until we have something in the same category.
[1] I'd even be fine with open weights, fair source, or anything that let us have direct access to the weights. Even if that came with stipulations. Don't hide the weights from us.
The argument on our side wins - if America or the West don't do open source, China will. And that means -- with certainty -- that China wins the market.
Every politician and VC should hear that loud and clear.
Given the pricing, it suggests that this model is much more efficient/competent than previous-gen OS/distilled models.
This is such a common omission: the Chinese models are open, you can host them yourself on your premises. So privacy and independence.
while I am skeptical that this is happening atm, there are probably many industries where the risk does not seem worthwhile
Maybe I just don't have any imagination.
Correction: Lots of organizations are refusing to use Anthropic Fable because they have forced opt-in data collection as part of their privacy policy, even for Enterprise.
Not everyone's going to care about Anthropic requiring data collection (a similar debate plays out with regards to "pay or consent" on website tracking), just as not everyone cares about China with regards to security/IP issues (if they did, a lot more would be banned besides occasionally-Huawei).
With Oracle being junk before this, more will follow.
This would drive down Anthropic's margins, but drive up demand for datacenter and GPU capacity. It's not that people would be using fewer GPUs, they'd just shift demand from high priced token vendors to direct GPU rental, which benefits datacenter companies while hurting Anthropic.
Now they are betting with Project Stargate but it also seems to be crumbling down.
But don't forget that they literally hold the biggest databases, both in commercial and open source, that is, Oracle Database and MySQL. Plus Oracle Java they literally controls at least 30% of the internet's software infrastructure.
And also with a good team of attorneies enforcing the licenses, they can squeeze so much money at the cost of morality.
Also recently they downgraded the always free OCI ARM instance from 4C24G to 2C12G without telling anyone.
They're drowning in debt and risk is increasing. If these US models don't keep holding up their valuation will tank further and some will recall the loans or ask for different terms.
The DeepSeek incident has already shown it, this is a reminder.
https://www.youtube.com/watch?v=LSlV206xPqM
These real world examples show it's one tier away.
(I mantain a client with llama.cpp and 101 models across 14 companies by http)
Having said that, the safety system on Fable makes it an extremely unattractive model. It feels that half of the time you're paying double for Opus level performance.
https://nitter.net/synthwavedd/status/2077537805715005724#m
(As an aside, I don't know how it was professional of Arena to unmask an unreleased cloaked model on their platform. Also practically, upstream could have been A/B testing multiple variants under same endpoint, casting validity of such pre-announcement tests into question)