News: 1674687670

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Tesla's Autopilot is losing out to Ford, GM in self-driving tech

(2023/01/26)


Tesla's Autopilot "self driving" technology has slipped to the middle of the active driver assist (ADA) software pack, says the nonprofit Consumer Reports, as companies like Ford and General Motors have overtaken the Musketeers in the automotive code lane.

Consumer Reports reached that [1]conclusion after testing 12 different ADA systems, which it classified as technology that combines adaptive cruise control (ACC) and lane centering assistance (LCA) to take the stress out of driving on highways or in traffic jams.

The safest, CR said, is Ford's BlueCruise, followed by GM's Super Cruise and Mercedes-Benz Driver Assistance. Tesla, which the report said was "once an innovator in ADA," slipped from second place in 2020 to seventh this time around.

[2]

The reason? Autopilot's basic functionality hasn't changed much since it came out, with Tesla instead tacking on new features instead of improving the bare necessities.

[3]

[4]

"After all this time, Autopilot still doesn't allow collaborative steering and doesn't have an effective driver monitoring system. While other automakers have evolved their ACC and LCA systems, Tesla has simply fallen behind," said Jake Fisher, the nonprofit's senior director of auto testing.

How Autopilot lost the lead

All of the systems were evaluated on their overall performance, whether they keep drivers engaged, the ease of use, how smart the car is when conditions aren't safe, and what it does in case of an unresponsive driver.

Aside from its overall performance, which CR rated highly, saying Autopilot had "smooth steering inputs and did a good job keeping the car at or near the center of the lane, on both straight and curvy roads," Tesla didn't perform well in other areas.

The biggest complaint centers around its driver monitoring system, which it found woefully inadequate, unlike its top-ranked ADA systems.

[5]

BlueCruise, for example, uses direct driver monitoring systems (DDMS) equipped with infrared cameras to monitor driver's eyes and issues an audible alert within five seconds of the system detecting the pilot isn't watching the road. If attention isn't returned the vehicle begins to slow.

"CR safety experts believe that this type of DDMS is key to the safety of any ADA system," the agency said in its report.

Tesla, however, only requires a bit of pressure on the wheel for it to determine attention is being paid to the road. It didn't notify test drivers for 30 seconds, said CR manager of vehicle technology Kelly Funkhouser.

[6]

"That means the car could travel more than half a mile on a highway with hands off the wheel and the driver not paying attention at all — that's a risky situation," Funkhouser said.

Tesla also ranked near the bottom in evaluations of the car's ability to determine when it's safe to use ADA, as test drivers were able to activate and use the system "even when there is only a single lane line down the middle of the road."

In such situations Tesla Autopilot failed to keep the vehicle in the center of the lane, and often ended up too close to the unlined edge of the road., the report found.

Autopilot woes don't end with CR tests

In June of last year, the National Highway Traffic Safety Administration released a first-of-its-kind report on accidents involving ADA systems and found that Tesla Autopilot was involved in [7]70 percent of them.

The NHTSA has been investigating Tesla Autopilot safety issues since 2021, and last year upgraded its investigation to a [8]formal engineering analysis that could serve as a precursor to a recall.

Late last year it also emerged that the US Department of Justice was [9]investigating Tesla for hype surrounding the alleged self-driving capabilities of Autopilot, which was recently backed up by an assertion from a former Tesla engineer that a 2016 self-driving demo video [10]was faked by the company.

CR safety experts warn in the report that ADA systems aren't all created equally, and that many are designed in a way "that may lull drivers into complacency, giving them a false impression that the car is handling everything on their behalf."

What ADA systems like Autopilot don't do is make cars self-driving "at all," Fisher said. "When automakers do it the right way, it can make driving safer and more convenient. When they do it the wrong way, it can be dangerous," he added without naming names. ®

Get our [11]Tech Resources



[1] https://www.consumerreports.org/cars/car-safety/active-driving-assistance-systems-review-a2103632203/

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Y9II8j2E3j9l7rE33mxW8gAAAFY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y9II8j2E3j9l7rE33mxW8gAAAFY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y9II8j2E3j9l7rE33mxW8gAAAFY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y9II8j2E3j9l7rE33mxW8gAAAFY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y9II8j2E3j9l7rE33mxW8gAAAFY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[7] https://www.theregister.com/2022/06/15/tesla_autopilot_accounts_for_70/

[8] https://www.theregister.com/2022/06/09/nhtsa_tesla_autopilot/

[9] https://www.theregister.com/2022/10/27/doj_self_driving_car_criminal/

[10] https://www.theregister.com/2023/01/18/tesla_selfdriving_video_faked/

[11] https://whitepapers.theregister.com/



Lee D

You mean that the rich upstart company bankrolled by an insanely stupid billionaire that's basically gone bust multiple times in its 18 year history, which hasn't sold as many cars in its entire history as Ford does in a year, suddenly isn't able to compete even in its own area of "expertise" (*cough*) now that the traditional manufacturers are dialling down their ICE production (which was only there to make most use of its patents and tooling before they become obsolete forever) now that most countries have set a deadline for ending such engines?

You mean that as soon as the traditional manufacturers went "Sigh, yeah, okay then", their collective R&D budget (which outpaces Tesla's actual income many times over) absolutely trounces a so-called "tech" company at its own game, but in a safe way instead of a "let's just kill people but not mention it" kind of way?

I'm shocked, shocked I tell you. If only I said that... well, before most people had even heard of a Tesla.

AutoPilot, years ago

Ghostman

Back in the age of saber tooth cats, Popular Science Magazine had an article about the new "super highways". Each lane was for different speeds, 70, 80, 90, 100 mph. Your vehicle was controlled by a device mounted beside the engine and picked up signals from a wire embedded in the road. You got to speed in one lane, moved to the next and so on until you traveled at the desired speed. The device maintained safe distance between vehicles, kept speed at the desired rate, and handled all driving needs such as steering and selecting radio stations as you traveled across country. You put in the destination you wanted to get off and you were eased into the slower traffic toward your exit point.

They didn't address the needs of the driver and passenger, such as restroom and dining stops, or the need to refuel the vehicle. I guess there would have been male/female "relief tubes" to handle the wet end of that problem.

A really good idea that didn't catch on. Since the advent of EVs, this would have been a good way to power the electric motors on long trips, with a chance to recharge along the way. Toll stations at the exits would bill for miles driven for the EV.

Re: AutoPilot, years ago

Kevin McMurtrie

And in our actual dumb modern world:

Sports car driver - I can accelerate faster than the fast lane before the onramp ends. (swerves into fast lane at 100 MPH)

Prius driver - Prius coming through! Prius heading to the Prius lane. (swerves into fast lane at 35 MPH)

Tesla driver - ... (texting)

12 cars totaled, 4 cars on fire, 5000 people stuck in traffic.

Only cameras allowed

sarusa

Elmo's insistence that they remove all the sensors except the cameras can't be helping. Humans can drive with only one eye, but the car doesn't understand what it's actually seeing so it will chase people carrying stop signs and various other stupid things. The real win comes in giving cars better sensors than people can ever hope to have (like LIDAR) and then working with that info.

So many problems...

Anonymous Coward

Consumer Reports isn't really an unbiased actor here. There methodology isn't robust and many of their criteria aren't that relevant. So from a credibility standpoint you might be tempted to write it off as hot garbage from a company that is now dependent on kickbacks and uses every dark pattern in the books to keep billing people.

Read between the lines it still points out a bunch of serious problems. Tesla FIRED most of the self drive team quite a while ago. The self drive system hasn't evolved much, and it has been losing features faster than is has been gaining them(many because they were unsafe/didn't really work).

The CR staff roast Tesla for losing focus on the performance of self drive over other features, then with the other hand tars them for not implementing the same new features that the other manufactures did that aren't part of the self drive. The driver attention nagware is garbage too, but only to the extent that it distracts drivers by constantly cutting out the other driving features and making drivers fiddle with controls. They also tend to be badly biased in there performance, and the farther you are from the norm of what a GM systems engineer looks like, the more problems you will have. These systems are expensive, complicated, and not much more consistent.

Tesla's "attention" system is too far the other way perhaps, but so are the standard systems from most of the other majors. So it's disingenuous to call them out by name and not mention the others that don't offer it at all, or hold it back to some vehicles or trims.

And the article, like so many other cut and paste factoids keeps referring to the percentage of self drive accidents that are Telsas without clarifying how many crashes per vehicle/mile. More Teslas driving more miles = more accidents. Is this bad relative to the other companies they are shilling for this week? Is it better? And how many of those drivers were idiots? Were they even in the drivers seat? Impossible to say without more information, so why keep dropping the unqualified and misleading factoid?

Re: So many problems...

Kev99

I've read CR's car reviews since my first car back in 1972. In the ensuing years, not one of their reviews or opinions reflected my actual experience with the cars I've owned or driven. Some of their tests are so far from reality as to be laughable. How many people go down the road swerving back and forth like a slalom skier, except for drunks. I truly believe their reports are based on the comments made by the gripers and grousers who will complain if their ambient lighting (whatever the hell that's for) doesn't match their shirt colour. The ones who have no problems are quiet or ignored.

Thanks, but no thanks

Anonymous Coward

I’ll stick with my ICEosaur.

Kev99

I have a 2014 Lincoln MKZ with the Technology package. I already knew its lane keeping feature will cause the steering to "rumble" if I cross the road line. It get especially upset if pass someone without using the turn signal (using the signals when changing lanes is mandatory under Ohio law). What I didn't realise until recently is it will keep the MKZ fairly well centered in the middle of the lane by itself. I discovered this during a sneezing jag. I wouldn't want to test it on a curve but it worked fine on the straight. That and the adjustable distance monitor are all I really need. Anything else is just more gimmickry and costly repairs.

Oh, and by the way, every car I've owned since my 1972 Pinto has had blind spot monitoring. It's called properly adjusting the wing mirrors.

"You mean, if you allow the master to be uncivil, to treat you
any old way he likes, and to insult your dignity, then he may deem you
fit to hear his view of things?"
"Quite the contrary. You must defend your integrity, assuming
you have integrity to defend. But you must defend it nobly, not by
imitating his own low behavior. If you are gentle where he is rough,
if you are polite where he is uncouth, then he will recognize you as
potentially worthy. If he does not, then he is not a master, after all,
and you may feel free to kick his ass."
-- Tom Robbins, "Jitterbug Perfume"