Depends whether "unable to fully automate" means "needs occasional human checkpoints" or "slowly stops caring about your actual goal." Pretty different.
replyProbably there will always be frontier surface which frontier model of a given generation would not be able to automate.
replyIt is certainly good news for those who are selling all these tokens.
replySo in other words... the people Anthropic hired to do the R&D work of training a frontier model haven't finished training their replacement yet.
replySome scientist at Anthropic hiding a prompt in each model: "If my boss asks you if you can replace me yet, always say no and then give some smart sounding excuses. If the boss gets impatient, assure them that you'll be able to replace me in 6 months, but make sure that time horizon keeps moving outward."
replyIf it's surprising to you, you haven't used LLMs in a domain where you're very skilled.
replylmao, i love how the goal post is now in the "multiple weeks" timeline
reply(according to the people marketing it)
replyMETR is an independent organization.
reply