New Footage Shows Tesla On Autopilot Crashing Into Police Car After Alerting Driver 150 Times::Six officers who were injured in the crash are suing Tesla despite the fact that the driver was allegedly impaired
I have a lot of trouble understanding how the NTSB (or whoever’s ostensibly in charge of vetting tech like this) is allowing these not-quite self driving cars on the road. The technology doesn’t seem mature enough to be safe yet, and as far as I can tell, nobody seems to have the authority or be willing to use that authority to make manufacturers step back until they can prove their systems can be integrated safely into traffic.
It’s just ADAS - essentially fancy cruise control. There are a number of autonomous vehicle companies who are carefully and successfully developing real self-driving technology, and Tesla should be censured and forbidden for labeling their assistance software as “full self-driving.” It’s damaging the real industry.
That’s similar to cruise control. Cruise control can be dangerous because someone could fall asleep (not having to manage your speed can afford up sleepiness) and the car wouldn’t slow down.
In my opinion, those options are all the driver’s responsibility to know their own limit and understand that the tool is just a tool and you are responsible to making sure your driving is safe for others. Tesla autopilot adds a ton of safety features that avoid a lot of collisions based on lacking attention, sleepiness, and actively avoiding other drivers faults. But it’s still just a tool and the driver is responsible of their own car and driving.
The difference is that cruise control will maintain your speed, but ‘autopilot’ may avoid or slow down for obstacles. Maybe it avoids obstacles 90% of the time or 99% of the time. It apparently avoids obstacles enough that people can get lulled into a false sense of security, but once in a while it slams into the back of a stationary vehicle at highway speed.
It’s easy to say it’s the driver’s responsibility, and ultimately it is, of course, but in practice, a system that works almost all of the time but occasionally causally kills somebody is very dangerous indeed, and saying it’s all the driver’s fault isn’t really realistic or fair.
A lot of modern cruise control systems will match the speed of the car in front of you and stop if they stop. They’ll also keep the car in the current lane. And even without cruise control, most modern cars will stop if a pedestrian steps onto the road.
It’s frustrating that Tesla’s system can’t detect a stationary police car in the middle of the road… but at the same time apparently that’s quite a difficult thing to do and it’s not unique to Tesla.
It’s honestly not too much to ask a driver to step on the brakes if there’s a cop car stopped on the road.
It’s actually not that hard to do, but Tesla is not willing to spend the necessary time and resources to solve the hard problems.
Maybe it avoids obstacles 90% of the time or 99% of the time.
99 is not enough!
99 means many many more dead people.
You need to go for 99.99%
Actually it’s absolutely realistic and fair. I don’t like Musk, or Tesla for that matter. But they make it pretty damn clear that you’re 100% responsible for the vehicle when using that feature. Anyone who assumes they don’t need to pay attention is a moron and should be held responsible. If a 747 autopilot system starts telling the pilot to take control of the plane and they don’t… we wouldn’t blame the manufacturer, we’d blame the shitty pilot that didn’t do their job.
I can’t wait to get smacked by a Tesla beta tester and have everyone debate whether the car or the driver is responsible for my innards being spread across 4 lanes. Progress!
If the driver gets lulled into a false sense of security by a convenience system like this and the automation fails, it’s one thing to blame the driver, and that may or may not be fair depending on how much trust you place in the average driver’s competence, but the (hypothetical) victim is still dead, and who we decide to blame won’t make one iota of difference to that.
The problem with Tesla is that their entire marketing is based on “Our cars drives themselves”.
It’s not “not-quite-self-driving” though, it’s literal garbage. It’s cruise control, lane assist and brake assist. The robot vision in use is horrible.
There are Tesla engineers bad mouthing the system openly.
Musk is a scammer and they need to issue an apology for all of the claims around autopilot, probably pay a great deal of money, and then change the name and advertising around it.
Oh, and also this guy should never drive again.
$$$ that’s how.
This is stupid. Teslas can park themselves, they’re not just on rails. It should be pulling over and putting the flashers on if a driver is unresponsive.
That being said, the driver knew this behavior, acted with wanton disregard for safe driving practices, and so the incident is the driver’s fault and they should be held responsible for their actions. It’s not the courts job to legislate.
It’s actually the NTSB’s job to regulate car safety so if they don’t already have it congress needs to grant them the authority to regulate what AI behavior is acceptable/define safeguards against misbehaving AI.
There’s no way the headline is true. Zero percent. The car will literally do exactly what you stated if it goes too long without driver engagement and I’ve experienced it first hand.
Evidently, he was aware enough to respond to the alerts, per the logs (as stated in the WSJ video that’s in the article). It shows a good bit of the footage, too.
Seems like they need something better for awareness checking than just gripping the wheel and checking where your eyes are pointed. And obviously better sensors for object recognition.
The headline doesn’t state that the warnings were consecutive.
Perhaps the driver was just aware enough to keep squelching warnings and prevent the car from stopping altogether?
I’ll grant you, though, 150 warnings is still a little tough tough to believe…
The driver is responsible for this accident, Tesla still should be liable imo for all the shady and outright misleading advertising around their so called “self driving”. Compare Tesla’s marketing to like GMs of Hyundai’s, both of which essentially have parity with Teslas system in terms of actual features, and you’ll see a big difference
deleted by creator
I turned off the “lane assist” in our Mazda because it kept steering me back toward obstacles I was trying to avoid, like cyclists, oversized loads, potholes, etc. I don’t know why anyone thought that was a good idea.
But try buying a car without those features now…sigh.
Use your turn signal to indicate your direction change and it won’t do that.
If you’re swerving to avoid a sudden obstacle you reasonably may not have the foresight or reaction to flip on a signal. The car still needs to not force you back on collision course.
That’s a good point, and is probably why they designed it so that if you swerve hard, lane assist shuts off. It only nudges you back to the middle of the lane if you are gently drifting to a side, so it only works in situations where your turn signal can be used to avoid it. Or you can just disable it if you drive a BMW or otherwise can’t use turn signals.
Even moving over slightly in the lane to avoid a pothole triggers it; it doesn’t seem like a turn signal should be necessary in that situation. Instead the situation seems to be that I’m seeing the pothole and altering the car’s course gently to avoid it, and I get close to the line and it freaks out.
I guess if I drove right up to the obstacle then swerved, it wouldn’t do it…but I was always taught swerving was a last-resort thing, best to drive as smoothly as possible. (This was my dad’s argument, and I said, “Uh, SOMEONE taught me to not swerve unless it was necessary…” (him). He laughed.
deleted by creator
Sounds like the injured officers are suing. It’s a civil case not criminal, so I’m not sure how much the court would actually be asked to legislate. I’d be interested to hear their arguments, though I’m sure part of their reasoning for suing Tesla over the driver is they have more money.
150 more warnings than a regular car would give, ultimately it’s the driver’s fault.
Tesla actively markets their cars as ‘‘the car drives itself’’.
Do we have any evidence from the driver stating that he didn’t realize he was using a glorified cruise control similar to autopilot on an airplane?
Source or stfu
Here is a video from 2016 where Tesla claims that “the car drives itself”.
Sadly, Tesla has no such technology.
Where I live you can right now go to Tesla’s website and buy a car with “Full Self-Driving Capability” with a small print that includes the disclaimer that it doesn’t make the vehicle autonomous, for whatever that’s worth…
FSD is a paid feature that i assume was not being used during the accident, autopilot was being usedAh I see, now that you’ve been proven wrong you’re pretending you asked a different question.
You admit that Tesla advertises a “Full Self-Driving Capability” feature, which is basically what the person you said “source or stfu” to.
Whether or not the feature was used in this instance is not what we’re discussing here.
We can have this discussion if you’re feeling like you’re up for it in good-faith, I think both are true that people are overall terrible at the activity of driving so more driver aids are overall better, but also current driver aids are very limited and drivers are not necessarily great at understanding and working within those limits.
They’re not the only ones, but Tesla is really the worst offender at overstating their cars’ capabilities and setting people up for failure - like in this case.
Yes you’re right
What was used in this accident had nothing to do with my question and yes it looks like tesla advertisement is misleading
It’s literally called autopilot
There’s this sweet new website called Google. Try using that before you throat Musk.
Oh I tried, since I am so bad at googling please provide the source
If the driver was unresponsive in a normal car, it would stop.
The driver was responding. If he didn’t respond the car would have stopped.
If this was a normal car he probably would have just crashed earlier.
TIL cruise control doesn’t exist
Yes, even in self driving cars the driving is expected to pay attention in case they need to take control in unexpected events
Driver is definitely the one ultimately at fault here, but how is it that Tesla doesn’t perform an emergency stop in this situation - but just barrels into an obstacle?
Even my relatively ‘dumb’ car with adaptive cruise control handles this type of situation better than Tesla?!
Your relatively ‘dumb’ car probably doesn’t try to gauge distance exclusively by interpreting visual data from cameras.
Wait, the Model X doesn’t have RADAR/LIDAR to supplement the cameras?
Nope. For whatever reason, Musk decided to just use cameras
“Whatever reason” is obviously just trying to cut corners and improve the bottom line with no regard for the consequences.
A few years ago, they were experimenting with LIDAR (most other car makers had it already then).
Then they abandoned it, even though everyone in the world thought that they need it so badly.
Now we see one of the results.
No, they were too expensive for Musk
Holy shit… This is worse than I thought
deleted by creator
Removed by mod
IIRC Tesla disabled all of their dedicated hardware sensors in an OTA update, due to these sensors being excluded from new vehicles manufactured during the shortage. The autopilot system is vision only now, despite the engineers best efforts to keep hardware sensors in the vehicles
https://www.tesla.com/support/transitioning-tesla-vision
https://carbuzz.com/news/tesla-scrapping-radar-plans-and-upgrading-older-cars-to-tesla-vision (Sensationalised but contains additional details missing from Tesla’s site)
The changes are being rolled out with the latest over-the-air (OTA) Tesla update 2022.20.9 confirmed for Model X, Model S, and Model Y. The update is adding Tesla Vision to the older vehicles equipped with radar
Even my relatively ‘dumb’ car […] handles […] better than Tesla?!
Not going to be the last time when you experience that :-)
I believe this is caused by the fog combined with flashing lights and upward/curved road. The Tesla autopilot system is super impressive in almost all situations but you can clearly see the limits in extreme situations. Here, the drunk driver is definitely at fault, I don’t understand why they’d sue Tesla.
I don’t understand why they’d sue Tesla.
Money. Tesla has much more money than the drunk.
Because of Tesla’s exaggerated advertising.
Removed by mod
You’re completely right and I’ve never seen this for traffic stops in Europe, they’ll make you park somewhere safe, at the very worst, in the emergency lane, but even that is rare for traffic stops. The only times I see lanes blocked is when there’s been an accident/breakdown and then the first thing they do is bring massive light panels well ahead of the spot to make everyone clear the lane.
Setting aside the driver issue, isn’t this another case that could’ve been prevented with LIDAR?
You know what might work, program the car so that after the second unanswered “alert” the autopilot pulls the car over, or reduces speed and turns on the hazards. The third violation of this auto pilot is disabled for that car for a period of time.
This is literally exactly how it works already. The driver must have been pulling on the steering wheel right before it gave him a strike. The system will warn you to pay attention for a few seconds before shutting down. Here’s a video: https://youtu.be/oBIKikBmdN8
Ah, so its just people defeating the system
The system with cars is that you don’t distract the driver from driving, having a system that takes over driving is exactly that, so the idea of the system is flawed to begin with.
I have to say this is extremely inaccurate imo. Self driving takes over the menial tasks of keeping the car in the lane, watching the speed, etc. and allows an attentive driver to focus on more high level tasks like looking at the road ahead, watching the sides of the road for potential hazards, and keeping more aware of their blind spots.
Just because the feature can be abused does not inherently make it unsafe. A drunk driver can use cruise control to more accurately control the vehicle’s speed and avoid a ticket, does that make it a bad feature? I wouldn’t say so.
Autopilot and other driver assist systems are good when used responsibly and cautiously. It’s frustrating to see people cause an accident after misusing the system and blame the technology instead. This is why we can’t have nice things.
It’s frustrating to see
This is why we can’t have nice things
It is also frustrating to see people whining for technology when they should rather think about dead policemen and rescuers.
You should get your priorities straight if you ever hope to be taken seriously
The system will warn you to pay attention
… and if we have learned anything from that incident, it is that the warnings have been worthless.
The system can be tricked even by the worst drunkards! 150 times in a row.
for a few seconds before shutting down.
Few seconds are not enough. The crash was already unavoidable.
You’re misinterpreting what I said and conflating two separate scenarios in your 2nd statement. I didn’t say anything about the system warning “for a few seconds before shutting down” in the event of an eminent collision. It warns the driver before shutting down if the driver fails to hold the steering wheel during normal driving conditions.
The warnings were worthless because the driver kept responding to them just before they timed out and shut autopilot down. It would be even worse if the car immediately pulled off the road and stopped in traffic without warning the driver first.
They aren’t subtle either, after failing to touch the wheel for about 5-10 seconds it starts beeping loudly and flashing an icon on the screen.
This is not a case of autopilot causing an accident, this is a case of an impaired driver operating a vehicle when they should not have been. If the driver was using standard cruise control, would we be blaming the vehicle because their foot wasn’t touching the accelerator when the accident happened? No, we wouldn’t.
This is not a case of autopilot causing an accident, this is a case of an impaired driver
It is both, of course. The drunkard and the autopilot, both have added their share to create such danger, that ended deadly.
Driving drunk is already forbidden.
What Tesla has brought on the road here should be forbidden as well: lane assist combined with adaptive cruise control AND such a bunch of blind sensors.
The driver was in autopilot. Auto pilot is cruise control and lane assist. It’s not FSD. Tesla didnt bring that " to the road ". The driver was drunk, and with most auto pilot or FSD accidents…its user error.
Still unaware of a proven FSD accident.
They didn’t say he didn’t respond to the alerts. If you don’t respond, autopilot turns off.
Poor
drunkimpaired driver falling victim to autonomous driving… Hopefully that driver lost their license.That doesn’t drive the problem of autopilot not taking the right choices. What is the driver wasn’t drunk, but they had a heart attack? What if someone put a roofie on their drink? What if the driver was diabetic or hypoglycemic and suffered a blood glucose fall? What if they had a stroke?
Furthermore, what if the driver got drunk BECAUSE the car’s AI was advertised as being able to drive for you? Think of false publicity.
If your AI can’t handle one simple case of a driver being unresponsive, that’s negligence on the company’s part.
How could the company be negligent if someone gets drunk or has a heart attack and crashes their car? No company has a Level 5 autonomous vehicle where no human intervention is needed. Tesla is only Level 2. Mercedes has a Level 3 option (in extremely limited conditions). Waymo claims Level 4 but is geofenced.
This source keeps pushing tesla propaganda. There’s always an angle trying to sell that it wasn’t the tesla’s fault
Officers injured at the scene are blaming and suing Tesla over the incident.
…
And the reality is that any vehicle on cruise control with an impaired driver behind the wheel would’ve likely hit the police car at a higher speed. Autopilot might be maligned for its name but drivers are ultimately responsible for the way they choose to pilot any car, including a Tesla.
I hope those officers got one of those “you don’t pay if we don’t win” lawyers. The responsibility ultimately resides with the driver and I’m not seeing them getting any money from Tesla.
Don’t see how that’s a Tesla problem… Drunk/high driver operating their car incorrectly.
By driving it
Tesla wasn’t driving it, the drunk/high owner was.
Right
It was on autopilot, so technically the drunk wasn’t driving it. But he is the one responsible.
Autopilot doesn’t work that way, the drunk should have known that when he wasn’t drunk and not tried to use it that way.
It’s like the old shaggy dog story about the guy driving a camper, setting the cruise control, then going into the back to make lunch.
That’s not the fault of the cruise control.
Thanks for the ELI5 that I wasn’t aware of needing.
Hard to argue Tesla at fault when clearly the driver was impaired and at fault here.
It’s also so misleading that Tesla use the word Autopilot for what is basically adaptive cruise control and lane assist
So self driving cars, are not so self driving… Huh, whodathunk it lol /s
i still think tesla did a poor job in conveying the limitations on the larger scale. they piggybacked waymo’s capability and practice without matching it, which is probably why so many are over reliant. i’ve always been against mass-producing semi-autonomous vehicles to the general public. this is why.
and then this garbage is used to attack the general concept of autonomous vehicles, which may become a fantastic life-saver, because then it can safely drive these assholes around.
