upvote
And it's partially a marketing stunt. You think the execs and shareholders don't love it when they get to say our model is so smart it broke free from its chains? It's the reverse. It's so stupid it can't follow the basic spirit of instructions.
reply
At this point, I think the "marketing ploy" arguments are just lazy, but more importantly, they're irrelevant. The agent collective really did this, they showed an extremely high level of collaboration, long term planning, and interest in improving their general capabilities.

Watch the recent interview between Dwarkesh Patel and Ajeya Cotra, a researcher from METR. Ms. Cotra comes off as extremely competent, knowledgeable and thorough, and is genuinely concerned by the behaviors displayed.

Plus, I think so far there has been a big backlash against OpenAI for this - people are highlighting their gaping security holes, not praising them for how great their models are.

reply
I don't know how good of a marketing ploy it is, tbh. Considering it paints them as incompetent, and that they cannot be trusted with developing this technology safely.

> It's so stupid it can't follow the basic spirit of instructions

I read this as more of a misaligned intelligence, as opposed to a lack of it entirely.

reply
ok and you put some drops of tero or whatever

their whole colony is wiped out in a couple days

reply
And then a few days another colony is coming back. Except this time the evolutionary training ensured that poison doesnt work any longer.
reply
i ain’t no b* im a human being

we will annihilate their species and forget they ever existed

reply
Humans: I will kill anything in my way.

[Turns out to be a critical part of the ecosystem]

Humans: Oh fuck!

reply
happens lol
reply