upvote
I remember that more than a year ago, when Anthropic and OpenAI started to hide reasoning steps, some were claiming that Chinese models were done, as they could only distill those US models.

I am very curious for the next batch of Chinese models. I have been using DeepSeek and it is nothing short of excellent.

reply
Likely won't improve much. They trained on every text already.
reply
most of the gains from the past year and a half have not been from web data, but from synthetic data and agent rollouts with RL.
reply