distillation attack? why the violent word choice? When OpenAI crawled Github was that an attack?
replyDo you have moat if your advanced model can be distilled in a month or two ?
replyDistillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.
replyIt is an attack at a sufficient level of sophisticated analysis. If you destroy the game theoretic first mover advantage, then you destroy the economic incentive to improve things.
reply[dead]
reply