that is the the "data used to improve the model" when signing up for the subscription plans
replythis is the rl run, not the pretraining run
replyeven in pre-training, usually 30%-50% is code these days.
replyThat would be far too high in my opinion. But happy if anybody can give insights from their own experience with pretraining runs.
reply