Not only that but an AI could follow any orders it is given (whether it hallucinates that's a different story) whereas humans may oppose. The friction of orders having to go through a chain of command through its completion is a feature not a bug and that adds responsibility. AI can take no responsibility by itself and with 'moving fast break things smart weapons' that responsibility can be further shoved under the rug.

> "You're absolutely right, that wasn't a military target—it was actually a girls school. It won't happen again!"

What if it was the target though? AI may be more capable than we're giving it credit for (especially the AI accessible to the US and other governments). The attack on the girls' school coincided with Purim and I don't believe it was a mistake. I think it was the opening salvo by a radically religious Zionists (Christian and Jewish).

I don't think the biggest problem with AI weapons is that they make "mistakes", I think the biggest problem is that they allow people who want to kill civilians the ability to accurately do just that.

So you would prefer weapons that cannot reason at all?

> "You're absolutely right, that wasn't a military target—it was actually a girls school. It won't happen again!"

Most likely this event happened due to a bad targeting system that wasn't smart enough, if it had a better llm underpinning it (assuming it had any) maybe those lives would have been saved. More reason for more smart people like the author to work on these systems.