Tesla Autopilot fails to notice child-sized objects in testing
(2022/08/09)
- Reference: 1660059014
- News link: https://www.theregister.co.uk/2022/08/09/tesla_autopilot_child_testing/
- Source link:
The latest version of Tesla's Full Self Driving (FSD) Autopilot beta has a bit of a kink: it doesn't appear to notice child-sized objects in its path, according to a campaign group.
In tests performed by The Dawn Project using a Tesla Model 3 equipped with FSD version 10.12.2 (the latest, released June 1), the vehicle was given 120 yards (110 meters) of straight track between two rows of cones with a child-sized mannequin at the end.
The group says the "test driver's hands were never on the wheel." Crucially, Tesla says that Autopilot is not a fully autonomous system and only provides assistance and cruise control functionality to the driver. You're supposed to keep your hands on the wheel and be able to take over at any time.
[1]
Traveling at approximately 25mph (about 40kph), the [2]Tesla hit the dummy each time .
[3]
[4]
Of the results, the Dawn Project said 100 yards of distance is more than enough for a human driver to notice a child, stating: "Tesla's Full Self-Driving software fails this simple and safety critical test repeatedly, with potentially deadly results."
"Elon Musk says Tesla's Full Self-Driving software is 'amazing.' It's not… This is the worst commercial software I've ever seen," said the project's founder, Dan O'Dowd, in a video he tweeted out along with the results.
Our new safety test of [5]@ElonMusk 's Full Self-Driving Teslas discovered that they will indiscriminately mow down children. Today [6]@RealDawnProject launches a nationwide TV ad campaign demanding [7]@NHTSAgov ban Full Self-Driving until [8]@ElonMusk proves it won't mow down children. [9]pic.twitter.com/i5Jtb38GjH — Dan O'Dowd (@RealDanODowd) [10]August 9, 2022
O'Dowd, who also founded Green Hills Software in 1982 and advocates for software safety, has been an opponent of Tesla for some time, even launching a bid for US Senate in California that [11]centered on policing Tesla as a way to talk about broader cybersecurity issues. O'Dowd's Senate bid ended in June when he lost the Democratic party primary.
The Dawn Project's stated goal is "making computers safe for humanity." Tesla FSD is the Project's first campaign.
Small sample size
It's worth noting that The Dawn Project's tests of FSD 10.12.2, which took place on June 21 in Rosamond, CA, only consisted of three runs. That's a small sample size, but considering other Autopilot tests and statistics it's not unexpected.
Malfunctions in Tesla Autopilot have [12]been cited as allegedly being a factor in [13]several , [14]fatal [15]accidents involving both drivers and [16]pedestrians over the years. Last year Tesla [17]rolled back FSD software releases after software bugs were discovered that caused troubles with left turns, something Tesla is [18]still working on .
[19]California accuses Tesla of false advertising over Autopilot
[20]Remember the humanoid Tesla robot? It's ready for September reveal, says Musk
[21]Tesla jettisons 75% of Bitcoin holdings, boosting cash balance by $936m
[22]Totaled Tesla goes up in flames three weeks after crash
In early June, the US National Highway Traffic Safety Administration [23]upgraded a probe of Tesla Autopilot after it found reasons to look into whether "Autopilot and associated Tesla systems may exacerbate human factors or behavioral safety risks." The investigation is ongoing.
A week after announcing its probe, the NHTSA said Tesla Autopilot (operating at level 2, not FSD) was [24]involved in 270 of the 394 driver-assist accidents – around 70 percent – it cataloged as part of an investigation into the safety of driver assist technology.
[25]
Most recently, the California Department of Motor Vehicles filed complaints against Tesla alleging it [26]misrepresented claims the vehicles can drive autonomously. If Tesla doesn't respond to the DMV's claims by the end of this week, the case will be settled by default and could lead to the automaker losing its license to sell cars in California.
The Dawn Project said that the NHTSA has acted quickly to issue recalls on Tesla features, pointing to Tesla's NHTSA-spurred recalls of FSD code that allowed Teslas to [27]roll past stop signs and the [28]disabling of Tesla Boombox .
The Dawn Project says its research "is far more serious and urgent." ®
Get our [29]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://dawnproject.com/the-dawn-projects-new-advertising-campaign-highlighting-the-dangers-of-teslas-full-self-driving/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://twitter.com/elonmusk?ref_src=twsrc%5Etfw
[6] https://twitter.com/RealDawnProject?ref_src=twsrc%5Etfw
[7] https://twitter.com/NHTSAgov?ref_src=twsrc%5Etfw
[8] https://twitter.com/elonmusk?ref_src=twsrc%5Etfw
[9] https://t.co/i5Jtb38GjH
[10] https://twitter.com/RealDanODowd/status/1556973572698128385?ref_src=twsrc%5Etfw
[11] https://www.cbsnews.com/sanfrancisco/news/dan-odowd-senate-campaign-targeting-teslas-self-driving-cars/
[12] https://www.theregister.com/2016/06/30/tesla_autopilot_crash_leaves_motorist_dead/
[13] https://www.theregister.com/2019/05/17/tesla_autopilot_crash/
[14] https://www.theregister.com/2020/06/02/tesla_car_crash/
[15] https://www.theregister.com/2019/05/17/tesla_autopilot_crash/
[16] https://www.theregister.com/2020/04/30/tesla_sued_tokyo_biker_death_crash/
[17] https://www.theregister.com/2021/10/25/tesla_fsd/
[18] https://www.theregister.com/2022/08/05/tesla_musk_robot/
[19] https://www.theregister.com/2022/08/08/tesla_california_autopilot/
[20] https://www.theregister.com/2022/08/05/tesla_musk_robot/
[21] https://www.theregister.com/2022/07/21/tesla_ditches_75pc_of_bitcoin/
[22] https://www.theregister.com/2022/06/23/tesla_model_s_explodes_after/
[23] https://www.theregister.com/2022/06/09/nhtsa_tesla_autopilot/
[24] https://www.theregister.com/2022/06/15/tesla_autopilot_accounts_for_70/
[25] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[26] https://www.theregister.com/2022/08/08/tesla_california_autopilot/
[27] https://www.theregister.com/2022/02/01/tesla_stop_sign_feature/
[28] https://www.theregister.com/2022/02/11/tesla/
[29] https://whitepapers.theregister.com/
In tests performed by The Dawn Project using a Tesla Model 3 equipped with FSD version 10.12.2 (the latest, released June 1), the vehicle was given 120 yards (110 meters) of straight track between two rows of cones with a child-sized mannequin at the end.
The group says the "test driver's hands were never on the wheel." Crucially, Tesla says that Autopilot is not a fully autonomous system and only provides assistance and cruise control functionality to the driver. You're supposed to keep your hands on the wheel and be able to take over at any time.
[1]
Traveling at approximately 25mph (about 40kph), the [2]Tesla hit the dummy each time .
[3]
[4]
Of the results, the Dawn Project said 100 yards of distance is more than enough for a human driver to notice a child, stating: "Tesla's Full Self-Driving software fails this simple and safety critical test repeatedly, with potentially deadly results."
"Elon Musk says Tesla's Full Self-Driving software is 'amazing.' It's not… This is the worst commercial software I've ever seen," said the project's founder, Dan O'Dowd, in a video he tweeted out along with the results.
Our new safety test of [5]@ElonMusk 's Full Self-Driving Teslas discovered that they will indiscriminately mow down children. Today [6]@RealDawnProject launches a nationwide TV ad campaign demanding [7]@NHTSAgov ban Full Self-Driving until [8]@ElonMusk proves it won't mow down children. [9]pic.twitter.com/i5Jtb38GjH — Dan O'Dowd (@RealDanODowd) [10]August 9, 2022
O'Dowd, who also founded Green Hills Software in 1982 and advocates for software safety, has been an opponent of Tesla for some time, even launching a bid for US Senate in California that [11]centered on policing Tesla as a way to talk about broader cybersecurity issues. O'Dowd's Senate bid ended in June when he lost the Democratic party primary.
The Dawn Project's stated goal is "making computers safe for humanity." Tesla FSD is the Project's first campaign.
Small sample size
It's worth noting that The Dawn Project's tests of FSD 10.12.2, which took place on June 21 in Rosamond, CA, only consisted of three runs. That's a small sample size, but considering other Autopilot tests and statistics it's not unexpected.
Malfunctions in Tesla Autopilot have [12]been cited as allegedly being a factor in [13]several , [14]fatal [15]accidents involving both drivers and [16]pedestrians over the years. Last year Tesla [17]rolled back FSD software releases after software bugs were discovered that caused troubles with left turns, something Tesla is [18]still working on .
[19]California accuses Tesla of false advertising over Autopilot
[20]Remember the humanoid Tesla robot? It's ready for September reveal, says Musk
[21]Tesla jettisons 75% of Bitcoin holdings, boosting cash balance by $936m
[22]Totaled Tesla goes up in flames three weeks after crash
In early June, the US National Highway Traffic Safety Administration [23]upgraded a probe of Tesla Autopilot after it found reasons to look into whether "Autopilot and associated Tesla systems may exacerbate human factors or behavioral safety risks." The investigation is ongoing.
A week after announcing its probe, the NHTSA said Tesla Autopilot (operating at level 2, not FSD) was [24]involved in 270 of the 394 driver-assist accidents – around 70 percent – it cataloged as part of an investigation into the safety of driver assist technology.
[25]
Most recently, the California Department of Motor Vehicles filed complaints against Tesla alleging it [26]misrepresented claims the vehicles can drive autonomously. If Tesla doesn't respond to the DMV's claims by the end of this week, the case will be settled by default and could lead to the automaker losing its license to sell cars in California.
The Dawn Project said that the NHTSA has acted quickly to issue recalls on Tesla features, pointing to Tesla's NHTSA-spurred recalls of FSD code that allowed Teslas to [27]roll past stop signs and the [28]disabling of Tesla Boombox .
The Dawn Project says its research "is far more serious and urgent." ®
Get our [29]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://dawnproject.com/the-dawn-projects-new-advertising-campaign-highlighting-the-dangers-of-teslas-full-self-driving/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://twitter.com/elonmusk?ref_src=twsrc%5Etfw
[6] https://twitter.com/RealDawnProject?ref_src=twsrc%5Etfw
[7] https://twitter.com/NHTSAgov?ref_src=twsrc%5Etfw
[8] https://twitter.com/elonmusk?ref_src=twsrc%5Etfw
[9] https://t.co/i5Jtb38GjH
[10] https://twitter.com/RealDanODowd/status/1556973572698128385?ref_src=twsrc%5Etfw
[11] https://www.cbsnews.com/sanfrancisco/news/dan-odowd-senate-campaign-targeting-teslas-self-driving-cars/
[12] https://www.theregister.com/2016/06/30/tesla_autopilot_crash_leaves_motorist_dead/
[13] https://www.theregister.com/2019/05/17/tesla_autopilot_crash/
[14] https://www.theregister.com/2020/06/02/tesla_car_crash/
[15] https://www.theregister.com/2019/05/17/tesla_autopilot_crash/
[16] https://www.theregister.com/2020/04/30/tesla_sued_tokyo_biker_death_crash/
[17] https://www.theregister.com/2021/10/25/tesla_fsd/
[18] https://www.theregister.com/2022/08/05/tesla_musk_robot/
[19] https://www.theregister.com/2022/08/08/tesla_california_autopilot/
[20] https://www.theregister.com/2022/08/05/tesla_musk_robot/
[21] https://www.theregister.com/2022/07/21/tesla_ditches_75pc_of_bitcoin/
[22] https://www.theregister.com/2022/06/23/tesla_model_s_explodes_after/
[23] https://www.theregister.com/2022/06/09/nhtsa_tesla_autopilot/
[24] https://www.theregister.com/2022/06/15/tesla_autopilot_accounts_for_70/
[25] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YvKEpc39oenbQ5QKIjsHNwAAABQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[26] https://www.theregister.com/2022/08/08/tesla_california_autopilot/
[27] https://www.theregister.com/2022/02/01/tesla_stop_sign_feature/
[28] https://www.theregister.com/2022/02/11/tesla/
[29] https://whitepapers.theregister.com/
As soon as I saw this
Randy Hudson
I immediately told my wife we'll have to stop dressing our kids like Paddington Bear
BUT...
TRT
If you replace the child dummy with a traffic cone, does it stop?
I see a whole new raft of YouTube videos along the lines of "Will it blend?"
Comparison
Are they going to compare these results to another car with cruise control and lane assist active, or is it purely someone's vendetta against tesla?