While I agree with your statement overall, as someone who drives everyday in LA alongside Waymos without anyone inside of them I must disagree with this aspect of it.
Because if it became fashionable for pedestrians to wear large green dresses with red balls, and everybody would wear that, we have no idea what the AI would do.
Edit: nevermind. https://www.cbc.ca/news/business/waymo-toronto-winter-self-d...
A truck or a car that has a 99% success rate would be the top threat to society and quickly rise to the leading cause of death under 30 if widely deployed.
99% successful web development where the 1% missing is security that and the company leaks its entire repository of user data every few months is not good.
99% successful car driving where 99% of 5-year periods have zero accidents per car is an order of magnitude safer than the average driver. (And gut feeling, I suspect approaching the tail-end of the safest drivers on the road.)
Wait, aren't human-driven cars already the leading cause of death under 30?
Do you live under a rock?
Developers are guilty of hubris and they are getting slapped back to reality.
Something I'm noticing a lot is that automation finds easy footholds in unregulated industries because there's no basis to push back on it. And there's a lot more tolerance for poor quality work in unregulated industries too.
All past inventions have put some of the most miserable humans out of a job. Farming by hand is hard, so is copying books and don't even get me started on the dullness of making clothes by hand.
Driving all day isn't all that far off, though still much better than the above and definitely better than riding horses all day.
Telegraph operators? Hell no. Dude sitting in an elevator all day? No thanks.
It's always been from the other end. This time around, there's gonna be some 10-20 years of robot manufacturing, then a universal lifetime of robots fighting misaligned robots until enough paperclips have been manufactured.
Or you know, we block out the sun and live in caves or whatever you fancy.