upvote
You couldn’t remember the term model collapse because people quit saying it shortly after it was invented in 2023, because it was just cope by people praying for that outcome. Internet will have LLM output, therefore models will train on that output, then kaput. And what happenend next? Models trained on model output on purpose and just keep getting better.
reply
Fair enough.

Well, I guess the answer isn't too different. I believe model collapse is a limitation of the current AI tech but maybe not the future ones. You can see humanity as a huge model that trains itself. What is novel about AI is that we built a machine with some intelligence traits that is free of biological constraints. If we can emulate the aggregate intelligence of a civilization inside a machine, it could improve itself forever but at a much faster pace.

reply