Surely that wouldn't last long if OAI/Anthropic stopped?
replyhard to say but it would last some time. china currently is fast-follow mostly via distillation. they don't have the compute resources to catch up. even if their models are more efficient it's hard to beat the folks throwing an unprecedented number of gpus at their models.
replyIf distillation was as easy as that, we would have 100s of competitors around the world.
replyChina is following because they have an army of PHDs in data science and mathematics and capital to make use of them.
no part of what i said implied distillation is easy. it is very costly and requires massive efforts. the payoff is you need less compute, which china is struggling to buy right now.
replyEDIT:
> China is following because they have an army of PHDs in data science and mathematics and capital to make use of them.
i agree with this too. but compute is the bottleneck.
Surely all of china has the resources to match a single ai lab?
replymaybe? all of china is not in a unified effort to match a single lab
reply[dead]
reply