seeing a jump this big is not a great sign for the continuing value of a benchmark
replyIt will continue to be valuable as a cost and speed benchmark long after it is saturated at the high end. And they are already working on ARC-AGI 4 and thinking about going even farther.
reply> I continue to believe ARC-AGI measures something different
replywhy is that? its now being benchmaxxed too