Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

"Tesla's Favorite Autopilot Safety Stat Just Doesn't Hold Up": https://www.wired.com/story/tesla-autopilot-safety-statistic...


There isn't actually any substance to that article. Why don't the numbers hold up?


It's covered in the article.

"NHTSA's Flawed Autopilot Safety Study Unmasked (2019) - The safety regulator's claim that Autopilot reduces crashes by 40% was based on flawed data and analysis, which it attempted to keep secret.": https://www.thedrive.com/tech/26455/nhtsas-flawed-autopilot-...

"Tesla Autopilot Safety Stats Said Imbued With Statistical Fallacies, Interpret Cautiously": https://www.forbes.com/sites/lanceeliot/2019/06/09/tesla-aut...

"In 2017, the feds said Tesla Autopilot cut crashes 40%—that was bogus": https://arstechnica.com/cars/2019/02/in-2017-the-feds-said-t...


These are refuting NHSTA numbers, not Tesla’s numbers.


According to the article it seems to be:

1. NHTSA has reiterated that its data came from Tesla, and has not been verified by an independent party (as it noted in a footnote in the report).

2. Second, it says its investigators did not consider whether the driver was using Autopilot at the time of each crash. (Reminder: Drivers are only supposed to use Autopilot in very specific contexts.)

3. And third, airbag deployments are an inexact proxy for crashes.

... which all sound like really flimsy reasons to conclude "doesn't stack up." A more honest summary based on those would be something like "hasn't been verified by a 3rd party yet."

It's incredible how openly the media makes things up about Tesla, likely just to generate page impressions.


That article is pretty old. More recent analysis is much more specific as to how the data is flawed, see tweet and associated paper:

https://twitter.com/Tweetermeyer/status/1488673180403191808

The primary issue is that the data doesn't adjust for road classification in any way. Highway driving, where autopilot is used, has considerably fewer crashes per mile than city driving. Tesla compared Autopilot's rates against all driving rather than just highway driving which would be the relevant metric.

That adjustment alone almost completely eliminates any safety advantage of Autopilot before you get into any of the other adjustments like age.


So being safer on highways should be completely disregarded? Okay so this Mercedes news should also be completely disregarded


Tesla's data doesn't even show that they are safer on highways, I don't think you understand the original criticism.

It's like this:

Tesla: Look how great we are, our apple is redder than their orange.

Critic: It doesn't make sense to compare the colors of those things in that way. Here's why ...

You: So being a redder apple should now be disregarded?


Tesla’s data shows autopilot is safer (crashes less) than not on autopilot. The only question mark I’ve seen in this discussion is on NHTSAs data regarding Tesla.

Could you explain the flaw in Tesla data? How is crashes/mile not a good proxy for safety?


Tesla count any crash above 12mph. Airbag deployment isn’t required.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: