The only way to make sure that a model was trained without hiding weird biases and backdoors is to monitor this process. It also allows anybody (with the hardware resources) to experiment with the model and how it's trained. Will most people want to do that? No, but most people also don't want to recompile their own kernel, that doesn't negate the value of Linux being FOSS.
I hope that, in the long term, I'll be able to use competitive, completely open models in the same way that I can run Linux on my computer.
You're completely right that the licensing of the training data is a big issue though (and I would argue that it should be a much bigger issue right now, even for closed models). I hope that eventually our understanding of the tech will let us build competitive LLMs using purely public domain/Creative Commons-style training data.
I realize that we have a long way to go... but that's a very worthwhile goal IMO.
If you want a trusted public model, we need to start a foundation that does it. The Linux of AI.
You’re going to need some serious money though.
I hope that the long term future of AI is more like Linux and less like Windows.
It is not a good faith request.
Also, what is this obsession with reproducing? Even if you could reproduce it, down to the RNG seed, that tells you nothing about whether or not some of the training data was malicious. You'd need an AI to go through the data and figure out if there is some malicious needle in a multi-petabyte dataset.
Releasing the model is good enough, because it is the only practical reality that makes sense.
Given the rate of progress of LLMs, I wouldn't be surprised if we had decent fully open and reproducible models within a decade or so, especially once the current spike in hardware price passes and building a local training cluster will be more realistic.
Tangent, and not the person you're replying to, but you just independently re-discovered why so many of us despise the AI companies.
Because that's what they are already doing. Selling a repackaged form of the stolen work of all of humanity, without credit or payment.
You might find this comparison stupid, but I think it is rather apt.
Reproducing a work does not mean you get all the exact same things that were originally used.
At best, I would agree releasing the index is valuable for understanding how the model was made.
But frankly, I don't think the people who demand all this effort are arguing in good faith.
You do not have access to the compute necessary to "reproduce" what they made. So it is a pointless request.