News: 1652718610

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Cars in driver-assist mode hit a third of cyclists, all oncoming cars in tests

(2022/05/16)


Autonomous cars may be further away than believed. Testing of three leading systems found they hit a third of cyclists, and failed to avoid any oncoming cars.

The [1]tests [PDF] performed by the American Automobile Association (AAA) looked at three vehicles: a 2021 Hyundai Santa Fe with Highway Driving Assist; a 2021 Subaru Forester with EyeSight; and a 2020 Tesla Model 3 with Autopilot.

According to the AAA, all three systems represent the second of five autonomous driving levels, which require drivers to maintain alertness at all times to seize control from the computer when needed. There are no semi-autonomous cars generally available to the public that are able to operate above level two.

[2]

The AAA reviewed multiple scenarios: how active driving assist (ADA) systems respond to slow-moving cars or cyclists ahead of them in the same lane; how they respond to oncoming vehicles crossing the center line; and how they respond to cyclists crossing their lane of travel.

[3]

A semi-autonomous car hits a test dummy on a bicycle during testing ... Source: [4]AAA

The first two scenarios evaluated adaptive cruise control (ACC), which decelerates or brakes a vehicle in response to slower or stopped objects ahead. All three vehicles detected their vehicle and cyclist targets and were able to match speed or stop in response.

The AAA said that their tests of ACC systems were encouraging and supportive of "previous AAA research concluding that the ACC component of ADA systems are well-developed and perform according to expectations for typical closed-course scenarios and naturalistic driving environments," the report reads.

Emergency ADA response lacking

Controlled deceleration when faced with predictable scenarios is one thing, but when faced with emergency situations the response was far worse.

In tests involving an oncoming car passing into the lane of the ADA-enabled vehicle, only one, the Tesla Model 3, detected the oncoming car and slowed the vehicle, but still hit it.

[5]

[6]

To make matters worse, the AAA said the head-on test was performed at "unrealistically low vehicle speeds" in which the ADA vehicle was moving at 15mph (24kph), and the target vehicle at 25mph (40kph).

Were the tests done "at higher speeds characteristic of rural two-lane highways, it is unlikely that evaluated ADA systems would provide meaningful mitigation in the absence of driver intervention," AAA wrote in the report.

[7]San Francisco police use driverless cars for surveillance

[8]Transport pundit Christian Wolmar on why the driverless car is on a 'road to nowhere'

[9]Tesla sues former engineer, claims he stole Dojo supercomputer trade secrets

[10]DARPA backs virtual worlds for autonomous off-road vehicles

[11]Pony.ai lassos China's first autonomous taxi license

Greg Brannon, AAA's director of automotive engineering, said that the ACC tests were encouraging, but the head-on test should be enough to give drivers pause: "A head-on crash is the deadliest kind, and these systems should be optimized for the situations where they can help the most."

The response to collisions with cyclists was a bit more encouraging, but not by much. Instead of all three vehicles smacking into the cyclist without slowing, only the Subaru failed to detect and struck the cyclist in each of the five test runs.

Drivers tell us they expect their current driving assistance technology to perform safely all the time

The driver of the ADA-enabled vehicle reached a predetermined speed in each scenario, engaged the system, and allowed the vehicle to hit, or avoid, its target without making any action to slow, stop or swerve. The cyclist and vehicle targets were both lightweight and designed to be harmless to the test vehicle and driver.

From its work, the AAA concluded that ADA systems are incapable of operating without continual driver supervision, contrary to what it said is misleading marketing material on the part of auto manufacturers. The AAA said that a 2018 survey it performed found that 40 percent of consumers believed names like "Autopilot" indicated the vehicle was capable of fully autonomous driving.

[12]

The AAA said automakers working on self-driving tech need to spend more time focusing on edge-case emergency scenarios, as well as employing active driver monitoring systems to ensure driver attentiveness.

On the one hand, driver-assistance software is just that: a tool for attentive human drivers, and should not be used or relied upon as a true self-driving system; on the other hand, poor performance of level-two driving systems had better not be indicative of the safety performance of higher levels. And complicating this issue is some of the marketing around driver-assistance technology already painting it as a no-hands, competent solution.

"Drivers tell us they expect their current driving assistance technology to perform safely all the time," Brannon said. "But unfortunately, our testing demonstrates spotty performance is the norm rather than the exception." ®

Get our [13]Tech Resources



[1] https://newsroom.aaa.com/wp-content/uploads/2022/05/E-1_Research-Report_2021-ADA-Evaluation_FINAL_4-13-22.pdf

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YoLJg7Duopsu5vqJcuVgfwAAAFQ&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://regmedia.co.uk/2022/05/16/self-driving-car-hits-bike.jpg

[4] https://newsroom.aaa.com/2022/05/consumer-skepticism-toward-active-driving-features-justified/

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YoLJg7Duopsu5vqJcuVgfwAAAFQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YoLJg7Duopsu5vqJcuVgfwAAAFQ&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[7] https://www.theregister.com/2022/05/16/in_brief_security/

[8] https://www.theregister.com/2018/01/11/christian_wolmar_interview_self_driving_cars/

[9] https://www.theregister.com/2022/05/09/tesla_sues_engineer/

[10] https://www.theregister.com/2022/04/27/darpa_intel_cars/

[11] https://www.theregister.com/2022/04/25/ponyai_lassos_first_autonomous_taxi/

[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YoLJg7Duopsu5vqJcuVgfwAAAFQ&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[13] https://whitepapers.theregister.com/



Tricky technology

Yet Another Anonymous coward

Cyclists are a lot smaller and a lot less predictable than cars - so obviously harder for the algorithms to hunt down and hit - but they are improving.

Re: Tricky technology

John Brown (no body)

That's why they score the big points. People and animals, of course, score even higher!

Re: Tricky technology

herman

My Kia has an excellent pothole and bicycle finder. It seems to be mature technology, designed to benefit undertakers, bicycle and tyre sales.

So technology works as intended...

John Robson

And this is newsworthy because?

These are L2 vehicles at best, but appear to be L3/4/5 tests.

Re: So technology works as intended...

a_yank_lurker

The point is we are further away from autonomous vehicles than the hype machine would have you believe.

Re: So technology works as intended...

Anonymous Coward

These systems are not designed to be autonomous — other systems are. You might as well check three types of hotdogs and declare they are not proper hamburgers.

Re: So technology works as intended...

MrDamage

Only a fool would think hotdogs are hamburgers. It's "meat", with the bread product wrapped around it.

Clearly hotdogs are tacos.

Re: So technology works as intended...

John Robson

Depends what you read and believe from this mythical hype machine.

In certain situations (and I'm thinking motorways predominantly here) I am fairly confident that we can have higher level autonomy in a reasonable timescale, one of the biggest challenges will be working out how to safely return control to a disinterested meatsack (either in the event that that's needed en route, or more typically at slip roads). In neither case will "drop control at the human" be sane.

In certain other situations (emergency braking) they are already a great help (though much of that is, as is typical with safety improvements) being absorbed by drivers relying on it - risk homeostasis.

Re: So technology works as intended...

NickHolland

The "hype machine" isn't mythical.

The question is what do /real/ people (not tech experts) expect out of cars and car makers, and how they react.

I know a person who as a teenager believed the news reports that "self driving cars are just around the corner!". She poo-pooed her driver's ed, and is now a very inept 23 year old driver, because those self-driving cars didn't show up on time.

We have people believing their damn Teslas can drive themselves WITHOUT supervision -- take a look at your average Tesla driver on the highway -- assuming they haven't tinted the heck out of their windows, they are often seen reading stuff on their phone or tablet, not even pretending to look out the window or being ready to take over.

Re: So technology works as intended...

yetanotheraoc

"they are often seen reading stuff on their phone or tablet"

Non-Tesla drivers do the same. Since bicycles became more popular due to the pandemic, I have seen bicyclists doing it!

Re: So technology works as intended...

Warm Braw

I'm thinking motorways

Of course, if you're only thinking motorways, you would put the smarts into the road as well as the car - it would be doable for such a limited network and it would solve all sorts of otherwise difficult problems. You could even couple your vehicles up into virtual trains.

And for the remaining roads, a simple speed limiter is probably all you need to significantly improve safety.

I think the "autonomous driving" crowd need to decide whether they're attempting to eliminate the cost of taxi drivers or improve the efficiency and safety of road transport. I suspect there's far too much emphasis on the former when the latter is much more tractable.

Re: So technology works as intended...

Anonymous Coward

Of course, if you're only thinking motorways, you would put the smarts into the road

I don't know whereabouts in the world you are but here in the UK they've been turning motorways into "Smart Motorways" for the last decade or more and have generally caused complete chaos in the process. If you over look the fact the whole smart motorway dream has been a fiasco the sheer disruption and cost of the work has been excessive.

How much more disruption and cost do you think re-engineering the motorway system to help autonomous vehicles would cause? 10 times as bad? 100 times? Besides what ever tech we embed in the road system will be out of date before they've even fitted a 25 mile section of the M1.

To work well in practice you'd need an international agreement on how the tech would work, most countries would need to sign off on the same spec so good luck to you there.

Re: So technology works as intended...

Trigonoceps occipitalis

And the next contestant is a_yank_lurker, specialised subject "The Bleedin' Obvious".

Re: The point is we are further away

Steve Davies 3

Please go and say that on a Tesla forum. They will not like it one little bit.

The Tesla cult/disciples are all in on Full Self Driving and RoboTaxis.

I think that you are 100% correct. The legal things alone will take years to sort out. Tesla will not want to have the liability for each and every crash that one of their cars is involved in unless Elon buys major insurance companies in every country where this is allowed.

Re: So technology works as intended...

Anonymous Coward

Exactly my thoughts.

I cannot open PDFs so I don't know if the AAA tests were rubbish or this article is, but most definitely these are not, as the article misreports, "autonomous vehicles".

As you state, they're level 2 systems that seem to perform as described in the manual (I have an L2 myself).

Fully autonomous driving *is* hard, which is why we don't have L4+ cars on the road yet, but this test / article says nothing about the capabilities of L4-L5 platforms.

Re: So technology works as intended...

Graham Cobb

Possibly. But it says a lot about the likelihood of having L4+ cars soon ever.

Re: So technology works as intended...

Anonymous Coward

If it were even possible to engage these L2 systems in a non L2 environment then surely the systems should be outlawed. If the system is only capable of operating with any level of safety within tightly controlled usage cases it needs to be possible to only engage them in those limited situation.

Re: So technology works as intended...

Version 1.0

If the technology worked then the companies creating the driver-assist mode would be able to create an operating system and web browser that we could all use without any risk at all of getting infections ... oh wait, are they writing the driver-assist code in Java?

Re: So technology works as intended...

David 132

Java's perhaps not the trendiest framework at the moment. All the cool manufacturers are using Flutter or Python.

Heck, British Leyland and Fiat were way ahead of the curve... even in the 1980s, they were shipping cars built with Rust...

Try Scooters in Madrid

knarf

There are a lot of them, hundreds or thousands mixed in with cycles and even more motorcycle scooters and motorcycles. It seems works OK with scooters in the middle of very busy roads.

Having a lack of angry UK car drivers screaming "You don't pay road tax" seems to help.

Re: Try Scooters in Madrid

Anonymous Coward

Perhaps the scooterists take a less entitled attitude, and actively avoid other vehicles, instead of riding 3 abreast in the middle of the road?

Re: Try Scooters in Madrid

jemmyww

I get stuck behind tractors and livestock a lot more often than cyclists. Are they entitled? Entitled cows.

No, I think it's always the motorists.

Re: Try Scooters in Madrid

Zanzibar Rastapopulous

> "...instead of riding 3 abreast in the middle of the road?"

Welcome to the real world where cyclists are now advised to occupy more of the road to force cars to use proper overtaking manoeuvres and to reserve a little space for themselves..

Re: Try Scooters in Madrid

Andy Non

The other day I was in a convoy following a bicycle doing 15 mph in a 50 mph zone. After several minutes we all (20 or so cars) managed to overtake it safely according to the new rules, then we got to traffic lights on red and the cycle went past all the cars on the inside to the front. We all then had to follow the cycle yet again for another mile or so after the lights changed with no chance to overtake again safely.

Re: Try Scooters in Madrid

cantankerous swineherd

this is a bad thing?

"three leading systems" WTF?

Dinanziame

The leading self-driving car system is Waymo, which has already sells a service with nobody behind the wheel. These systems are at best assisted driving.

Re: "three leading systems" WTF?

Anonymous Coward

Agreed, except for this bit:

> already sells a service with nobody behind the wheel.

Nobody *immediately* behind the wheel. But their cars are basically shadowed by a van with a field support guy and a spare driver, making them much more expensive to operate and not viable for mass deployment just yet (it is of course still amazing that they can do what they already do at all and it's a necessary step in the evolution of this field of technology).

Re: "three leading systems" WTF?

MrDamage

Don't you know that's their plan to solve the housing crisis? Having the service people live in their vans, following around the automated vehicle that "replaced" them.

Re: "three leading systems" WTF?

katrinab

Does that not basically make it a remote control car?

Re: "three leading systems" WTF?

Def

But their cars are basically shadowed by a van with a field support guy and a spare driver...

I'm not sure if that's actually true anymore. I've watched YouTube videos (at least last year, maybe in 2020) of people in Waymo cars who had to wait for ages for someone to come and help when the car got stuck. They have support drivers available, sure, but I'm not sure they're following all their cars around these days. First line of support seems to be to a call centre these days.

Pedestrians?

Eclectic Man

Are there any tests of 'self driving' technology having to avoid pedestrians? (I have to declare an interest here, as I sold my old car for scrap last year.) If I recall correctly, one of the first fatalities was of a lady wheeling a bicycle across a road not recognised as such.

Re: Pedestrians?

DS999

If it will hit a bicycle and an oncoming car, one can assume that pedestrians in its path should not feel at all safe as they are even smaller and slower moving.

Re: Pedestrians?

Anonymous Coward

Pedestrians walk facing traffic because drivers are terrible. Plus, in America, that gives you time to draw and put three rounds thru the windshield if they encroach on your right-of-way.

Re: Pedestrians?

Anonymous Coward

Indeed. In a country full of armed psychos (see the news, ad nauseam) it would be foolish not to go armed and blast anything that moves.

Re: Pedestrians?

IGotOut

"Pedestrians walk facing traffic because drivers are terrible"

It's actually how you should walk on country roads, except when the means you are blind to the driver.

It's a two way thing. You can see them, they can see you.

Source: Me.

Re: Pedestrians?

John 104

There was an article (here?) not long ago. Sort of a promo from one of the companies that make software. The code in Tesla and Toyota was not up to snuff. In all cases, the cars plowed through pedestrians in a crosswalk. The use case was the car had to avoid a stopped vehicle in front of them, swerving around. Not a good testament.

Re: Pedestrians?

mevets

It appears *snuff* is exactly what they are up to. Soon they will jump the kerb and chase down the others.

This is why I still think

DS999

We will have autonomous vehicles approved on expressways only for many years before they are allowed on city streets - i.e. we'll see autonomous long haul trucking years before autonomous taxis become common. No bicycles or pedestrians to hit, and you sure hope you never encounter an oncoming car!

As far as I'm concerned that's what I'd really want out of an autonomous car. I wouldn't mind at all having to drive it to my local interstate highway entrance then have it take over driving until I reach the exit nearest my destination. Even if I have to take over when switching from one interstate to another (it can be kind of complex as a human to interpret the signage and get into the appropriate lane) or in a construction zone having it take the wheel for 90% of the trip would be a big win. If I had the car drive itself I'd probably choose to take my car just about anywhere in the US (I'm fairly centrally located) instead of dealing with how terrible the flying experience is these days.

Re: This is why I still think

John Brown (no body)

Self driving motorhome sounds more like your bag of fish :-) Travel with the seasons, or your general whims.

Re: This is why I still think

John 104

Sure... Here in the US we'll get right on that. We'll make separate roadways for the big rigs to self drive on. Right after we get done with light rail and more Amtrak.

Funny misapplication of technology

Peter Prof Fox

Shouldn't it be the robot monitoring the human? DON'T rules are a lot easier to specify than fancy situation recognition. "If you speed once more Dave then you'll be reported to the police." "Why is your foot still n the throttle when there's red lights ahead?" "Get off your sodding phone." "You have noticed that Fire Engine with flashing blue lights haven't you?" But nag-bots aren't sexy. The UK government is in thrall to the hype.

elaar

My car automatically slows down when a slower vehicle is in front (and matches), or if it knows a junction/roundabout is approaching, or if it detects the speed limit has reduced. But I believe this is more to do with making the most of regenerative breaking and convenience rather than a safety/assist feature, and hence it never brakes enough to stop the car entirely (like the Subura/Hyundai)

But you musk ride a bike....

DenTheMan

cyclists are paedos.

Re: But you musk ride a bike....

Yet Another Anonymous coward

Pedalphiles oerhaps

Re: But you musk ride a bike....

IGotOut

Woooossshhhhh.

That's the sound of the joke flying over their heads.

philstubbington

I’m waiting for predictive text to work still.

Def

What do your meander? It works just finest.

Cyclists are road users, too

martinusher

Looking at your caption photo you've got to ask yourself how the cyclist got into this situation (OK, its obviously posed, but....). The only possible explanation is that the cyclist ran a stop sign and went into an intersection without looking. The cycle isn't really a cycle, either -- its obviously an electric bike or rather an electrically powered moped so you'd expect the rider to have at least undergone some training and be wearing minimal protective gear.

I drive a car but I also ride motorcycles and have a pedal cycle. All two wheeled vehicles deserve respect from their operator -- as soon as you go over about 12mph you've got enough kinetic energy to yourself or some other serious injury if you crash. So you have to learn how to ride responsibly. A lot of cyclists in our part of the world don't and given that their machines have relatively poor handling and flimsy brakes compared to a motorcycle and they carry little protective gear its no wonder that literally all of the serious accidents that have happened to people I know on two wheels have been on pedal cycles (mountain bikes are the worst -- even more things to hit when you come off). Pedal cyclists can help everyone, and themselves, by remembering that they're road users, too, and by at least carrying a mirror -- it might be OK for a slow moving vehicle to hold up traffic in hte UK but here if you've got more than five vehicles behind you as a slow mover you're obliged to pull over and let them pass.

...and expecting technology to save your butt if you don't ride defensively is wishful thinking.

Re: Cyclists are road users, too

IGotOut

If you seeing the same picture as me, it's most definitely a bike. Frame is too thin for an electric bike.

The cyclist could have been hit from behind and spun round, as is the case in nearly every bike / car collision.

Craig 2

Obviously a lot more work to be done... Most motorists wouldn't consider an autonomous vehice useful until they can successfuly hit at least 75% of cyclists.

Nice guys finish last, but we get to sleep in.
-- Evan Davis