Or we could assume since new data is increasingly AI generated then the next generation of models are inherently born out of incestuous relationships so I would imagine Claude's grandson is going to be a dwarf.
replyOf course it is possible also that Claude will marry a chinese model (since it's asian odds are it is also smarter) bringing some diversity into the "gene" pool. Or better yet, a Russian supermodel.
Are you sure that AI model progression and the height of your family members are 35 is related? It seems unlikely but I guess you'd know better than I.
replyThat's their point, we can't assume model capabilities will go up linearly forever just because they have increased quickly in the past
reply"We're running out of data, so LLM progress is hitting a wall" was a prominent late-2024 narrative. Back then many experts including Ilya used the word "plateau" when describing LLM progress. No one is using that word now, and there is no evidence we are about to reach a plateau, even though we ran out of data long ago.
replydeleted
replydeleted
replyIf we didn't have any humans before your grandparents, and these were the only data points we have to extrapolate from, then, yes, this would be a very reasonable prediction.
replydeleted
reply