No, llm providers will start providing a service that looks a lot like rumination or (day)dreaming. Like thats the prompt "you're daydreaming about this work you recently did" then add in whatever is in the current session.
replyWhy do they do it this way? Because dogfooding is harmful to the model? Is this implying there's no benefit in having the model train on itself?
reply> Is this implying there's no benefit in having the model train on itself?
replyThere are various theories around model collapse when you train on too much AI generated data (that's not for distillation).