Why would you trust a models opinion about its own possibly emergent ability?
replyThat's my point. The human says it can't do it -- but maybe they can.
replyThe frontier labs will make damned sure their models can't do this, if they haven't already.
reply"So I just asked Astra if it thinks it could do this and it said no, it can't." Same. Then I asked it to check the article and it said something like, "uh, it looks I was wrong...".
reply