Came directly to comments hoping not to see this one.
reply<sad trombone sound>
Surely someone will soon do what the title of this post makes it seem like cloudfare did. Truly modular open source training and inference logic, along with a totally open corpus and weights, will eventually out-compete the closed ecosystem.
There are some groups doing it for LLMs - like the Allen Institute for AI's Olmo models and Eluether AI's Pythia.
reply