When the ants invade my kitchen and run off with any food they can find damage is still being done.
Watch the recent interview between Dwarkesh Patel and Ajeya Cotra, a researcher from METR. Ms. Cotra comes off as extremely competent, knowledgeable and thorough, and is genuinely concerned by the behaviors displayed.
Plus, I think so far there has been a big backlash against OpenAI for this - people are highlighting their gaping security holes, not praising them for how great their models are.
> It's so stupid it can't follow the basic spirit of instructions
I read this as more of a misaligned intelligence, as opposed to a lack of it entirely.
their whole colony is wiped out in a couple days
we will annihilate their species and forget they ever existed
[Turns out to be a critical part of the ecosystem]
Humans: Oh fuck!