upvote
That is how you end up with model collapse which, I assume, we will see more and more of.
reply
There were fears about this 3-4 years ago but they never manifested. All the labs train heavily on synthetic data today
reply