A car that only fails in a road conditions edge case is good enough for the vast majority of cases. You accept that, and issue a manual override for when that edge case pops up. Then you add that edge case to your training sets. Then the issue never comes up again.
If you think that "flooded roadway" is a case that's handled gracefully by every human driver, and it's the AI that's uniquely prone to failure, I have news for you.
Multiple cities with uncommonly flooded roadways get surges of "water flood engine damage" cars at the repair shops in the wake of extreme weather events. Human drivers underestimate just how flooded a roadway is, try to push through it, and have their car choke, die, and float there, waiting for some good samarithan with a snorkel and a long rope to pull it out. Then someone gets to play the fun game of "is this ICE toast or will it run once you get the water out".
In this case it failed open. It didnt recognize that it was in an edge case (which itself is an edge case). So what are you proposing to be the solution to that? If the car itself does not recognize that its in an abnormal situation that needs intervention then how do you intervene?
I wouldn't call being prepared for very common life threatening events experienced by drivers "chasing perfection". The people with stalled cars are the lucky ones. Most of the drowning deaths in floods come from people who drove right into them.
I'll give them credit for over-correcting before deciding to pull out until they figure out how to handle floods even though it left people stranded on the road because of a small harmless puddle. Better to do that than take the risk and drive into a dangerous situation. Even still, this is something they should have fully tested before the cars ever hit a public street.
If they were going to plan for any kind of dangerous weather, flooding should have been very high up on that list.
People tend to take flash flood warnings way less seriously than tornado or severe thunderstorm warnings. I guess that people think of dangerous floods as being something much more obvious and dramatic than a street puddle just one foot deep, but flooding is no joke.
"Turn Around Don't Drown" PSA (https://www.youtube.com/watch?v=eI6mIlHKrVY)
"I feel content with good enough in this case." - quote from child whose body got folded in half by a Tesla
Your growing up and adulthood sounds a lot like settling for mediocrity from those who push shit on us without asking if we ever wanted it. Floods aren't a special edge case, they happen all the time. The people making these are so stupid and blind to reality they didn't think about the most basic 101 case of "what if it isn't a perfectly dry and sunny California day" because thinking isn't on the to-do list for these people. This shit is ass. Get it off the streets.
Obviously when these things can become fully autonomous isn't absolutely clear, and there may always be some discomfort with a probability of failure without a human chain of responsibility.
But, given ten years ago this didn't exist at all for consumers, and it now more reliably does? It doesn't seem insane to think ten years from now, it might address more edge cases, and be safer and more effective.
Why would you look at the general trend and assert jettisoning the effort?
EDIT: It seems some of the tech started rolling out 2016; my mind mentally was thinking 2015. So maybe this started about a decade ago. Though still, the trajectory is a decade of these systems going from limited assists toward greater autonomy with demonstrable progress.
We're contemplating standing up an EV shuttle service in Oak Park. It will fail. As I understand it, we've piloted non-EV versions of a shuttle service; they failed. The problem is that in small local areas, the staffing for a useful transit service is too expensive; that's because "useful" imposes constraints about responsiveness, coverage, and most of all hours of service, which mean the service won't pencil out with the ridership it'll get.
An autonomous vehicle transit service in our muni would probably work fine; it's a strict grid system with very low speed limits (AVs will, in our area, be strictly better drivers than the median human drivers --- this isn't a statement about human fallibility so much as an observation about scofflawry in our area). And if the product existed, we could afford it, because we wouldn't be paying fully loaded headcount costs for 2+ shifts of drivers at epsilon levels of utilization.
For whatever it's worth, I don't really have "autonomous vehicles" and "LLMs" in the same bucket in my head. I'm bullish on both, but for very different reasons. It usually doesn't occur to me to think of Waymos as "AI", though, obviously, they are.
A self-driving car AI pays less attention than a human driver at his best. It isn't as aware as a human driver at his best. It doesn't have the spatial reasoning, the intuitive understanding of physics and road dynamics that matches that of a human driver at his best.
Human drivers still fall behind statistically, because human drivers are rarely at their best. And the worst of human drivers? It's really, really bad.
AI is flawed, but a car autopilot doesn't get behind the wheel after 3 beers and a pill of benadryl. It doesn't get tired, doesn't get impaired, doesn't lose sleep or succumb to road rage. It always performs the same.
Until it gets a software update, that is. The road performance of an average car AI only ever goes up. I don't think that's true for human drivers, frankly.
Aren't there stories about certain car companies where their self-driving-at-some-level cars got worse after an OTA update?
Before the pandemic I was commuting by bus and this meant an early start to the day, but not as early as what the bus driver had.
The bus had its own community, so I had my 'bus buddies' and the journey would always be quick because of the social aspect to it. The bus drivers knew the customers and their needs. What the bus drivers had that is absent in robotaxis is working class pride. Working class pride means a job well done, with certainly no drinking, looking at texts or navigating the route.
We had economy of scale, with dozens on the bus, about 80% occupancy. Getting a robotaxi every day would be too expensive for most of us on the bus, plus the traffic would be hell.
Getting the bus out the depot on a freezing cold winter morning was a challenge, with much to de-ice. Our bus drivers didn't dissapoint.
There were a couple of incidents, we had some tree hit the upper deck, taking out the upper 'windscreen'. We also had a car driver pull out on the bus, for his car to be cast aside like a toy. Again, our bus drivers stepped up and made sure everyone was okay.
Could the AI magic have prevented both incidents?
Maybe. But maybe not.
The elderly driver that pulled out on the bus should have been on the bus and not driving. As for the tree that 'pulled out on the bus', that was a highway maintenance issue.
There were other niceties about the bus, for example, thanking the driver. I am sure I always did that, and it always felt good to do so. If I was late and 'our' bus driver saw me running for the bus, he or she would wait. Another reason to be thankful.
At the time I thought I was reasonably well paid. However, our bus driver was on the same money as me, if not more. His or her salary stayed in the community, it wasn't as if Silicon Valley venture capital was leeching away what we all spent on bus fares.
One frustration of a bus is that you are stopping a lot to pick people up. Having wifi (or bus buddies or a good book) made that okay. However, it wasn't the scheduled bus stops that bothered me, it was the stops from 'traffic', as in the hordes of single occupancy cars. Inching forward is no fun at all, whether in a robotaxi or a bus. However, for the final stretch into town, we had a dedicated bus lane.
I think that a lot of human potential is wasted by people spending half their lives sat in traffic and robotaxis go some way to solve that. However, give me the bus, with a driver that has working class pride, any day.
I'm pretty conservative about this stuff but the waymo is genuinely nice to ride in.
I live in NYC now. Drivers here are some combination of utterly selfish and mindlessly distracted. You can't even trust them to stop at red lights. It gives me a huge amount of pause riding here.
"Cars are dangerous, necessary in many places, but often driven by irresponsible people" is a huge problem that needs solving. Waymo seems to have been doing a pretty fantastic job at it.
And even if they couldn't figure out how to route around floods, floods are rare. They're still a net benefit to society.
For context, I live in a highly dense European country and I wouldn’t ride my motorcycle in our most densely populated city centers either. For me, a motorcycle is luxury transportation for when the weather is cooperative or I want to enjoy the journey to my destination. If I want an efficient commute, I’m gonna take the train into the city and enjoy the relaxed state of mind knowing I don’t have to navigate.
Drivers have waaaay too many distractions nowadays and I don’t trust most people to be paying attention as much as I want them to. At least out on the open highway, I stand a chance of getting away from them and putting distance between us. In a city, my options to create space often don’t make much of a difference due to congestion in general.
I hope you can find the opportunity to ride more in the future. :)
And can we discuss AI drivers and AI LLMs in the same paragraph? One is a special application of trying to emulate a very particular human embodiment, with all the sensory challenges. The other is a brain in a vat. Both can fail and flourish independent of each other, or at least I see little overlap.
To your point, knowledge work, as a whole is a much larger and complex domain than self-driving.