When people say distilling they mean SFT on other models outputs.
replyIn their thinking and if you ask them, I've seen Kimi K3 and other models confidently say that they are Claude from Anthropic, and accuse you of attempting to jailbreak them if you say otherwise.
replyThey're cope, as if Anthropic or OpenAI have some magic moat, and not just basically a headstart and more money.
replyBe honest with me, have you ever done SFT training? If not can you really speak to how useful it is?
reply