They explain it here: https://openai.com/index/how-two-settings-tripled-our-arc-ag...
replyTLDR: The official ARC harness throws away old context and reasoning. No real-world harness is this bad, the model has to re-learn the game repeatedly. OpenAI basically just added standard compaction. Their harness is still "general".
Then why is unemployment around 4%? You believe we have AGI and yet it can’t do anyone’s job?
replyDidn’t I just see a thing about how actual unemployment is at like 24% a few days ago?
replyAccording to that interpretation, ~24% is one of the lowest ever.
reply(I have not gone down the rabbit hole to understand how they achieve that 24% number)
Workforce participation is different than unemployment. Didn't click the link but I suspect that's the case with your 24%
reply24% sounds correct to me. Many of my friend who completed phd are currently unemployed .... And, some of them started doing random job like uber to make a living.
replyIf government don't step up and regulate outsourcing like 100% tax, big problems are coming up.
If you're doing a job you aren't unemployed. Underemployment is measured separately
reply24.9% is damn close to the 24.8% average over the ast 25 years, for the thing it's measuring-- jobless, people working part-time or involuntarily, and workers earning less than $26,000. Since 2000, it's been over 30% for more years than it's been under 24%.
replyWe were already there with Opus 5 -> https://www.linkedin.com/pulse/nvidias-harness-hit-100-arc-a...
replyAFAICT nvda's result is on the 25 open problems, while this submission is on the "semi-private" set, ran by the arc people themselves.
replyI rest my case.
replyThe goal moving is by design, that’s why they use something as ill defined as AGI
replyThat’s because AGI, like a lot of terms, has no meaning besides what each individual subjectively projects onto it.
replyI agree, like the average human isn't generally intelligent.
replyIMO, AGI is literally no different from ASI, though people think it is. Like, Imagine you have 1,000 generally intelligent humans working for you (which nobody is really) and you were to point them at your pet project. That would be amazing!
> We will now see the goalposts moved
replyIt's already happening :)
Hilariously it is, I'm just reading more on this!
reply