If distillation was as easy as that, we would have 100s of competitors around the world.
replyChina is following because they have an army of PHDs in data science and mathematics and capital to make use of them.
no part of what i said implied distillation is easy. it is very costly and requires massive efforts. the payoff is you need less compute, which china is struggling to buy right now.
replyEDIT:
> China is following because they have an army of PHDs in data science and mathematics and capital to make use of them.
i agree with this too. but compute is the bottleneck.
Surely all of china has the resources to match a single ai lab?
replymaybe? all of china is not in a unified effort to match a single lab
reply[dead]
reply