It seems they are trying to thread a needle here - they want to say it's very strong, but apparently this time do not want to invite extra government scrutiny.
replyThey do say that (implicitly unlike Mythos) Opus 5 was not trained to exploit software vulnerabilities, which would certainly make it safer in that regard.
"As with its predecessor, Opus 4.8, we’ve intentionally avoided training Opus 5 on cyber tasks. The model has nevertheless improved substantially on these tasks as a result of becoming more generally capable, and it comes close to Mythos 5 at finding cybersecurity vulnerabilities. However, it remains substantially behind Mythos 5 on the exploitation of those vulnerabilities—that is, in turning vulnerabilities into material cyber threats."
Easy enough to explain: they're benchmaxxing. Fable is intelligent but not benchmaxxed. Opus is less intelligent but benchmaxxed.
replyYep , same with 5.6. Fable is still the best.
replyBut still nerfed compared to the initial release.
replyOnly when you hit the cyber classifiers.
replyHonestly that's the simplest explanation and thus likely the correct one.
replyCapable in term of AI R&D, not capable in terms of hacking (which caused all the Fable drama.) But agree, confusing wording.
replyMaybe they don't want to say that to avoid the government scrutiny.
reply