14 ms·
I don't know anything about this specific case but this exact thing will be a major barrier for autonomous vehicles to overcome. Instead of benchmarking AVs aga
by rco8786 9d ago
I don't know anything about this specific case but this exact thing will be a major barrier for autonomous vehicles to overcome. Instead of benchmarking AVs against the current, human-caused number of vehicular deaths - people will naturally benchmark AVs to 0 and treat every instance of death as a failure of AVs, even if the reality is that AVs end up 99% safer than human controlled vehicles.
- TNWin 9d agoAs it should be. “Safer on average” is not a defense for failing something as basic as stopping at a stop sign. The bar for not running one and killing someone is not unreasonably high.
- returningfory2 9d agoI agree; that’s why I think we need a moratorium on human drivers while we figure this all out.
- ray_v 9d agoThis also solves the rising oil and gas prices issue as well!
- msy 9d agoWe do tend to impose them on individual drivers who make egregious and consequential failures, that’s the point. If every car running the same software is functionally the same ‘driver’ this class of failure absolutely should trigger a moratorium.
- superb_dev 9d agoI think this is a fantastic distinction to make, and one I haven’t seen before.
- lotsofpulp 9d ago>We do tend to impose them on individual drivers who make egregious and consequential failures, that’s the point. Do we? It's a common saying that if you want to kill someone with no penalties, have them run over with a car. Then there are examples like these all over the place. Not to mention distracted driving and DUIs don't even get your license suspended in many or most jurisdictions. https://www.seattletimes.com/seattle-news/law-justice/teen-who-killed-4-in-renton-crash-sentenced-to-prison/ https://www.seattletimes.com/seattle-news/law-justice/teen-w... >The Audi, which Jones had bought one month before the crash, was the third car he had totaled in a crash within 11 months. Speed was a factor in all three collisions, but police did not cite Jones in the first two crashes, prosecutors said.
- crooked-v 9d agoAlso see the 80-year-old woman in SF who killed an entire family at a bus stop, while speeding, while going the wrong way on a one way street, and was sentenced to probation and community service and banned from driving for three years.
- ImJamal 9d agoHumans fail to stop at stop signs all the time. Their failure to stop kill people as well.
- unrented7977 9d agoAnd we take away people's ability to drive when they kill people.
- criddell 9d agoOften we do not. The Freakonomics podcast had an episode titled The Perfect Crime where they basically say if you want to kill somebody, hit them with your car because that’s often not punished beyond a ticket.
- lotsofpulp 9d agoThis trial just happened where there was no punishment: https://www.macombgov.org/node/55/news/former-warren-police-officer-found-not-guilty https://www.macombgov.org/node/55/news/former-warren-police-... >According to evidence presented from law enforcement at trial, on September 30, 2024, Burke was operating his patrol vehicle at a high rate of speed without emergency lights or siren activated when it crashed with another vehicle. Burke's partner was injured in the crash, and 34-year-old Cedric Hayden Jr. and 33-year-old Dejuan Pettis were killed. Then there was this one a couple years ago: https://en.wikipedia.org/wiki/Killing_of_Jaahnavi_Kandula https://en.wikipedia.org/wiki/Killing_of_Jaahnavi_Kandula https://www.theriolindanews.com/2025/04/22/529861/license-to-kill https://www.theriolindanews.com/2025/04/22/529861/license-to... https://calmatters.org/investigation/2025/04/license-to-kill/ https://calmatters.org/investigation/2025/04/license-to-kill...
- bdangubic 9d agoNot sure why you are getting downvoted here though yes, the system is not perfect, in some states more so than in others. it is a fine line between giving someone who deserves it a 2nd chance vs. someone with 17 priors. but guessing you would also agree that allowing "self-driving" tech to kill people on the road without any repercussions isn't all that ideal either?
- wat10000 9d agoIt should be a critical part of the evaluation. If you set the bar higher than “safer on average” then you’re going to delay the switch, and every month of delay will cost more lives. “Safer on average” is exactly when you should start using the new thing, even if it’s uncomfortable and even if it’s a low bar.
- ddj231 9d agoNo it shouldn’t. Low risk behaviors should equal low risk outcomes. If it’s safer on average yet causes low risk behaviors to suddenly become unpredictably dangerous, folks will very reasonably push back
- wat10000 9d agoSorry, I’m not following. What are the low risk behaviors you’re referring to and what makes them suddenly become unpredictably dangerous?
- mvkel 9d agoIt should be a defense for FSD to exist though, right? Net more alive people.
- saulpw 9d agoNo, because you can punish bad drivers, remove them from the driving pool, put them in jail, or in some way achieve justice (this may not always happen, but at least it's posible). There is no way for FSD to have any accountability, and so no justice can be served. "Sorry, your son was just unlucky that he was killed by the AI, but we can't do anything about it" is an intolerable breakdown of justice. Same problem we have with qualified immunity.
- maxrev17 9d agoYou can update software though, you can’t update a negligent driver.
- EA-3167 9d agoBut you can take their license, fine them, jail them. Corporations just pay a fine and move on. I don’t want that to be the standard for road accidents and frankly outside of this techie niche no one does.
- srveale 9d ago"Sorry, the driver could have turned on FSD, but decided to drive [drunk/tired/distracted] and killed your son. Thankfully we can ban them from driving for a while." This could play out a million times at the population level. If you can decrease the chances of needing justice in the first place, shouldn't that be considered?
- mvkel 9d agoWhat you're talking about is who to blame, not how to keep more people alive.
- datsci_est_2015 8d ago
- piloto_ciego 9d agoSafer than average is totally defensible, because every year the margin of what is "average" changes. I'm just pulling numbers out of my ass here, but if say, one person is killed by an automobile every 100m miles, if the next year the average is 0.999 per 100m miles, that's a good thing provided the trend continues. We should not step over a dime to pick up a penny.
- milch 8d agoI do think there's a point where introducing different failure modes is harmful. Say they end up causing more pedestrian crashes and more head-on & angle crashes (such as the one in this article), but less loss-of-control and fixed-object crashes. That would make it safer for occupants but less safe for non-occupants of the self-driving vehicle. Since the occupant is the ones engaging self-driving mode they should be the one carrying the risk, so IMO even if it reduces number of deaths overall it should not be allowed
- EA-3167 9d agoWhat percentage of road accidents involve broken down old cars, drugs and alcohol, irresponsible and risky behavior? Because most of us don’t have that problem, and insurance stats suggest we’re a hell of a lot safer drivers than a hypothetical aggregate including stolen car joyrides by teens and 50 year old teetotalers in a well maintained, modern car.
- kay_o 9d agoImho part of isuse here is that you cannot "partial AV" it. You cannot have a car that will EVER need you to intervene or else it does not work because of awful human nature. The amount of tesla uber drivers ive had literally browsing tiktok, watching youtube UNTIL the car beeps that it is a green light detected, then they immediately hit the accelerator before looking up is ridiculous. You cannot have a half ass "autopilot" driving experience where you are expected to zone out and then be expected to take control within a millisecond during uncertainty. It does not help that FSD, AP, aAP, bAP, the model, whether the car is visual only all apply differently
- Terr_ 9d agoAnother huge problem is that error rate it not error shape. We have an enormous body of knowledge and process for guessing what might cause problems for human drivers, how to deter the problems, and how to mitigate the damage. For example, you'll have a pretty good idea how our fellow humans will react to rumble-strips if I describe them or play a recording. I don't need to consult a datasheet or design an AI test suite with a zillion simulations and a bunch of closed-course tests.
- rco8786 6d ago> I don't need to consult a datasheet or design an AI test suite with a zillion simulations and a bunch of closed-course tests. Traffic engineers have been doing this for decades though?
- kybernetikos 9d agoTeslas do very badly when benchmarked against human caused deaths in similar (luxury) vehicles.
- ryathal 8d agoSafer than the highest level numbers isn't really a win though for autonomous driving. All human caused deaths includes drunk drivers, inexperienced drivers, and elderly drivers. An autonomous system should never be any of those things, so comparing them against is disingenuous at best and outright manipulative at worst.
- rco8786 6d agoThat's extremely silly. drunk, inexperienced, and elderly drivers are all human drivers. You can't just exclude them from your baseline because they are not in perfect driving form. Let's also exclude young drivers, stupid drivers, distracted drivers, drivers who never took driver's education classes, short drivers, barefoot drivers, glasses-wearing drivers who forgot their glasses, and one handed drivers. The insane variation of human drivers is exactly why AVs should ultimately bring vehicular deaths down..which is the goal.
- ryathal 5d agoYou absolutely can and should exclude the known bad drivers from the stats because they are essentially outliers. If you don't, it's very possible that widespread adoption of AVs actually makes the average driver more dangerous.