They are not a black box, they passed rigourous examinations and they stick to principles enshrined in constitutions and laws.
Technology, or better, the productization of it, is instead the result of the interest of very few powerful individuals or corporations and aggressive product market fit iterations.
The bullish discourse around the PMF loop says that this is good because it is better at solving people's problems. But after a few decades it is obvious there's a gigantic risk the process actually exploits people's problems instead of actually solving them.
It also ignores the reality of going to a jury. Yes you have the right to trial by jury. But the price to exercise that right is to risk an much much more severe punishment, a lot of money, and a lot of time.
There's also tremendous upside here. Think getting a letter from your landlord withholding $2,000. Upload it to JudgeGPT for your jurisdiction and instantaneously find out it's legal.
All humans are black boxes and the black box argument is completely invalid just like your statement. In fact your statement illustrates the downfall of human intuition. You could not logically invalidate my point so you descended into side channels that’s not far off from “hallucinations.”
Late-stage capitalist tech products left unchecked exploit human problems for profit.
If you cannot see the difference and the flaw in your argument I am afraid you're too far gone.
The whole point of “jury of your peers” is that your guilt or innocence is being decided by people with common life experience to you and thus the possibility of empathy and judging you fairly.
Ignore the fluff. Focus on the logic and stay rational. The black box argument is not at all valid.