(nit) "immoral" is "anti-moral". I suspect you want "amoral", that is "without" or "separated from" morals.
But, if you wanted "immoral" ... what about matrix math derived from gradient descent is inherently "immoral" in your view?
“AI” in the widest definition possible could do while a lot of harm without being a net negative. I’d be way more concerned about the healthcare sector than the military as the military already has significant collateral damage.
The fear around military AI is more about its failure than anything else, but nobody is trying to make fully automated machines which are manufacturing bombs from raw materials. Blowing up the wrong building matters a great deal to the people in the building, but for humanity a building was going to be destroyed either way. So the risk at any one point ends up being quite limited.