upvote
US companies published their research on transformers. The only reason Chinese companies have any models at all is open US research...

Add distillation to that, and the entire Chinese AI sphere is really just an offshoot of public US AI information...

reply
Science doesn't work this way, someone could claim only reason World is successful because Chinese invented paper, so please don't go there.

Regarding distillation, you can also say Anthropic and OpenAI stole /distilled books, articles, blogs from everyone who published things without knowing their work might be used against them

reply
> Science doesn't work this way, someone could claim only reason World is successful because Chinese invented paper, so please don't go there.

Perfectly valid claim. It could be debated though, since you are talking about a centuries long diaspora of processes.

I'm talking about an architecture that was invented, published, and pioneered by US companies just a few years ago. Not really the same argument IMO.

> Regarding distillation, you can also say Anthropic and OpenAI stole /distilled books, articles, blogs from everyone who published things without knowing their work might be used against them

Yes. I would argue that anthropic et al are only able to exist because of the massive body of work in the anglosphere, both in books and online. That goes hand-in-hand with my view of the Chinese AI sphere.

reply
All LLM’s are distillation of stolen copyrighted materials, some of which are the outputs of other LLM’s.
reply
US companies started by publishing their research, but then they have stopped abruptly, seduced by the mirage of heaps of money that could be obtained by having a monopoly on AI.

During the last few years, the published research from USA was only a small fraction from that published from China.

reply