...because the self-driving feature turned itself off after detecting the crash in the fractions of a millisecond before the crash was recorded
replyIn a rare bit of still-sane news, the US National Highway and Safety Administration staff aren't dumb: Their policy is to consider whether any automation was active in 30 seconds before the crash.
replyhttps://www.nhtsa.gov/laws-regulations/standing-general-orde...
How many million dollars do you think will reverse this policy?
replythe whole concept of having cars with that are almost capable of self-driving is utterly insane, the very least you'd need special training. We are not equipped to deal with something that works brilliantly most of the times but might kill you for no foreseeable reason.
replyYeah, that's definitely the frustrating zeitgeist for me these days, which extends to LLMs.
replyI'd also emphasize that it's not just error rate, but the shape/distribution of errors, and our (in)ability to build control systems around them.
To illustrate, imagine if someone unveiled a car which was unambiguously safer in every statistical measure... buuuut some of its unsafety was came jumping the curb to target and kill pedestrians, for reasons we can't predict or diagnose.
Even pilots are getting this automation-complacency now. A plane crashed because the military jammed GPS and the pilot wasn't used to any backup procedures even though 30 years ago they were the only procedures.
reply"Uh oh, this is a problem. Welp, I'm outta here, good luck."
reply