upvote
On the contrary, I found it a nice piece of rethoric to reflect on how misaligned incentives can overrule each individual's preferences in order to induce the group to take the opposite path.
reply
It's done in jest but I think I am accurately pointing out the interesting parallels between what these companies say they are doing (aligning models) and what they are not doing (aligning themselves).

If you listen to them, and you don't have to listen very hard to hear it, basically everyone at these labs is telling us that this technology is extremely dangerous and should be slowed down or paused entirely. Yet, they, the only entities with the power to actually do anything about it, are not acting AT ALL as if that's the case. They are all barrelling forward as quickly as possible. RSI, THE number one risk according to these guys, is being adopted at breakneck pace up and down the stack, from designing silicon, to training, to inference.

It's ridiculous and insane and I believe can be accurately summed up as, they are being assholes, because if they are actually right about this we are all gonna die. At the very least, and far more likely, every fun creative expressive human thing that is machine legible will be replaced by a torrent of machine slop. It's not "benefiting humanity." These mathematicians are telling you it's not benefiting humanity. It sucks.

Alignment problem.

reply