upvote
> they're not just ripping the outputs of another model that someone else invested billions to train.

True, they're simply ripping the inputs that humanity invested thousands of years and trillions of dollars to produce.

reply
no argument from me here
reply
Yeah agreed, from one standpoint I couldn't care less that they did a "distillation attack", but I am interested in knowing if China is able to develop open weight frontier models without the prior existence of a huge model to distill from.
reply
Simply knowing it is possible to do something makes it easier to do.
reply
[dead]
reply
> they're not just ripping the outputs of another model that someone else invested billions to train.

If they payed for inference, doesn't they own the output? So if I pay for a model to generate code, isn't that code mine to do with it whatever I want? Just curious.

reply
Why would that matter? OpenAI or whatever frontier lab couldn't have built their frontier models without the entirety of humanity unknowingly developing their training set for 5000 years.

It would be one thing if Moonshot was breaking into OpenAI servers and stealing trade secrets, but the only thing they are doing is looking at the output of the program, which is exactly the service that OpenAI offers. So, at best, this is a ToS violation. Sucks for the frontier labs I suppose, but live by the sword - die by the sword.

reply