upvote
Now, ask yourself if you want AI taking decisions around your life... it will pull numbers... someone will have a "goal" of 1000 "hits" and there you go, 2-3 months in jail working to check what went wrong...

But don't worry, the other P AI system will ensure that the first one doesn't do mistakes...

reply
Lawsuit Says UnitedHealth Used AI With a 90% Error Rate to Deny Care - https://www.yahoo.com/news/us/articles/lawsuit-says-unitedhe... - September 18th, 2026

UnitedHealth uses AI model with 90% error rate to deny care, lawsuit alleges - https://news.ycombinator.com/item?id=38299921 - November 2023 (58 comments)

https://litigationtracker.law.georgetown.edu/wp-content/uplo...

reply
what makes ai special here? a person following an SOP that involves polling an incomplete dataset will have the same 2-3 months in jail
reply
The person can be sued for negligent, retaliatory, and otherwise crappy decision making.
reply
People often tend to stop in these situations.
reply
Important context is that the notes about the changing use of the location weren’t even in a connected system. Unclear if the human analysts would have even caught this, or if they would have known to check this unconnected system.

> Some US intelligence analysts took notice, the officials said. Bloomberg reported in June that one analyst detected changes to the site as early as 2019, and logged remarks about the modifications in a system that wasn’t connected to the primary military intelligence database, which informs targeting

reply
>"Unclear if the human analysts would have even caught this" (seizethecheese)

At the time a news outlet put out commercially purchased images of the target site before and after -- even a layman could see that it had a children's playground next to the building, and that it was separated from the compound.

https://www.channel4.com/news/factcheck/factcheck-iran-schoo... has the info from around the time, but doesn't show the detailed images in the news report (video) I seem to remember seeing.

I think it was maybe some earlier coverage from NYT, they published this retrospectively - https://www.nytimes.com/video/world/middleeast/1000000107503... (which is also on YouTube, https://www.youtube.com/watch?v=hDcim48W4Io). It shows that even a cursory analysis - without the benefit of enhanced military grade satellite/flyover imagery - indicates the building targeted with pin-point accuracy is a school (eg https://youtu.be/hDcim48W4Io?t=98).

In short, this seems entirely avoidable. I don't think you need any connected system, you just need an image of the target and eyes.

If they trained a model to find targets and didn't train it to avoid civilian targets, and couldn't be bothered to have anyone check them, that's still a war crime. The analyst could probably see the kids playing there with the imaging tech they have available.

This war was unlawfully started by the military at Trump's command, knowing it was not a lawful order; just as they knew firing on shipwrecked civilian sailors was murder. Seemingly it was started to win money betting on fuel prices.

reply
"In the final days of February, the Trump administration demanded an overwhelming aerial assault. More than 1,000 Iranian targets were hit within the first 24 hours alone. That order compressed the time frame for finalizing targets, the officials said, instilling an urgency that — combined with gaps in underlying information about the site, cuts in civilian-protection personnel and an overreliance on artificial-intelligence technology — set the stage for the deadly error."

-------------------

Maven is an untested tool for rapidly selecting targets under time pressure during a war. It's reason for existing is speed. If you're in a shooting war, the ability to select good military targets faster than your enemy, but not necessarily with zero error, is an advantage.

Planning a first strike is a different situation. Time pressure should not be a significant factor. Humans should have been doing their due diligence on every single target. If an untested tool for rapid mid-battle target selection was relied upon completely because of a hasty executive order, then the responsibility falls entirely on the executive.

reply
Great point. Less deadly but just as incompetent was the utter failure to refill the Strategic Petroleum Reserve when gas was cheap for a year leading up to this war of choice; a war that was certain to massively disrupt global energy markets. Energy disruptions had been an obvious consequence to every expert and non-expert who had looked at attacking Iran for decades. Yet the people who chose to start the war managed to be caught completely off guard by that.

Just like clowns in charge were caught off guard by the fact that Iran has a drone program, resulting in the loss of dozens of air frames and much of our strategic munition stockpiles. Iran literally jump started Russia's drone program in a high profile way, and yet trump/hegseth somehow completely failed to plan for how to counter those drones and had to resort to lobbing scarce multi-million interceptor missiles at them and watching our bases take heavy damage.

These are just some of the failures we know about. The administration has been extremely tight lipped about these failures and there are surely many more that aren't common knowledge. Who knows how many hundreds of other children have been needlessly killed outside of the school strike.

reply
I think that’s the important distinction. Mistakes under pressure do happen. Unnecessary pressure is not a mistake, though, it’s a crime in this context. They could start planning earlier or commit to action later.
reply
Well the order wasn't lawful, Congress hadn't countenanced a war.

Unfortunately the military all turned their backs on their oath to uphold the constitution (Again! Deploying against USA cities and kidnapping foreign heads-of-state at the whim of Trump is also not lawful). At that point it is hard to see how your democracy can be resurrected.

reply
Seems like a scenario where two completely avoidable wrongs....killed 120 children. AI being one of the wrongs.
reply
"A computer can never be held accountable / Therefore a computer must must never make a management decision" https://simonwillison.net/2025/Feb/3/a-computer-can-never-be...

Except laundering our biases & discriminations, the unaccountability seems to be the purpose of a huge huge swarth of AI usage. To eliminate accountability. That sure seems like A Feature Not A Bug to the worlds worst people.

reply
reply
> “No more politically correct and overbearing rules of engagement,” - Hegseth

...

> Hegseth and the commander in charge of the Iran operation, Adm. Brad Cooper, were questioned about the strike before Congress. Hegseth said the U.S. does not target civilians and would investigate

So the administration does not intentionally target civilians, they have just stopped caring about who a civilian is.

reply
Well Israel has defined "combatant" as "male between 14 and 55", and the Western world more or less shrugged and moved on without missing a beat. I'm not optimistic.
reply
That, unfortunately, originates more from the US than Israel.

https://en.wikipedia.org/wiki/Military-age_male

reply
[flagged]
reply
The accepted answer here has a decent source:

https://skeptics.stackexchange.com/questions/56556/does-the-...

> fight in civilian clothing

(Fake) physician, heal thyself.

https://www.pbs.org/newshour/world/israeli-undercover-forces...

> Article 4 applies to soldiers (that e.g. fight in uniform)

Israel openly forbids the importation of uniforms.

https://www.jpost.com/arab-israeli-conflict/israel-seizes-la...

reply
Not sure wtf “politically correct” in the context of rules of engagement even means.

What a fucking moron

reply
Instead of worrying about woke things like "is this person actually a combatant actively fighting" they want the much simpler rule of "everyone we kill was actually a terrorist that deserves to die".

Basically they stopped caring those woke UN rules about war crimes.

reply
[dead]
reply