Cruise emits software fix after self-driving car slams into bus
- Reference: 1681157357
- News link: https://www.theregister.co.uk/2023/04/10/cruise_software_update/
- Source link:
On March 23, one of the upstart's driverless vehicles hit a Municipal Transit Authority (Muni) bus when the car failed to detect the bus had decelerated and didn't brake in time. Nobody was injured in the accident; the car, which didn't have a human at the wheel and was under computer control, suffered minor damage to its front fender.
But El Reg , we hear some of you say, don't human drivers also make mistakes and bash their vehicles up; surely this kind of prang happens every day in a city like SF? Be as that may, we dare to dream of AI-driven cars that are more competent than your average schmo.
Cruise launched an investigation into the prang, and discovered its autonomous vehicle had struggled to correctly predict the Muni bus's driving behavior due to its bendy shape. Articulated buses, like those in San Francisco, have a stretch-accordion-like structure in the middle that connects two carriages.
When the bus pulled in front of Cruise's self-driving car and slowed down, the AI-powered vehicle incorrectly assumed the bus was still charging ahead, and wrongly predicted the motion of the rear carriage. The car continued to drive normally and failed to brake as required, causing it whack into the back of the bus.
"We quickly determined the bus's behavior was reasonable and predictable," Cruise founder and CEO Kyle Vogt [1]said in a statement just before the weekend.
[2]
"It pulled out into a lane of traffic from a bus stop and then came to a stop. Although our car did brake in response, it applied the brakes too late and rear-ended the bus at about 10 mph. We identified the root cause, which was a unique error related to predicting the movement of articulated vehicles like the bus involved in this incident."
[3]Self-driving car computers may be 'as bad' for emissions as datacenters
[4]People still seem to think their fancy cars are fully self-driving
[5]British industry calls for regulation of autonomous vehicles
[6]Self-driving bus in crash just 2 hours after entering public service
"In this case, the [autonomous vehicle] (AV) view of the bus's front section became fully blocked as the bus pulled out in front of the AV," the boss continued.
"Since the AV had previously seen the front section and recognized that the bus could bend, it predicted that the bus would move as connected sections with the rear section following the predicted path of the front section. This caused an error where the AV reacted based on the predicted actions of the front end of the bus (which it could no longer see), rather than the actual actions of the rear section of the bus. That is why the AV was slow to brake."
[7]
[8]
Cruise issued a software update to address the error two days after the crash, and filed a report
[9]PDF
detailing "a voluntary recall" with America's National Highway Traffic Safety Administration this month. The software patch was deployed to 300 vehicles.Vogt said Cruise's cars had never encountered this type of smash before and believes the specific combination of different factors, such as the bus' position, the time of its deceleration, and the self-driving vehicle's speed all led to the collision.
[10]
"Although we determined that the issue was rare, we felt the performance of this version of software in this situation was not good enough. We took the proactive step of notifying NHTSA that we would be filing a voluntary recall of previous versions of our software that were impacted by the issue," he said. ®
Bootnote
You may recall Cruise and San Francisco were in our headlines in July last year, when the autonomous vehicles struggled to cope with traffic and [11]clogged up the city's streets for hours. This continues to be a problem in SF, seen as America's epicenter of experimentation with self-driving rides, with dashcam footage [12]obtained by WiReD from public buses and trains showing a Waymo robo-ride getting in the way of a bus and delaying it.
Muni staff have reportedly been encouraged to record instances of trouble with driverless cars. A dozen log entries were made against self-driving vehicles from September 2022 to March 2023, though it's feared the true figure is much higher.
Get our [13]Tech Resources
[1] https://getcruise.com/news/blog/2023/why-we-do-av-recalls/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZDSHC6sTwufGViMkAHHu@AAAAJc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.theregister.com/2023/01/13/selfdriving_car_computers_could_equal/
[4] https://www.theregister.com/2022/10/11/cars_not_self_driving/
[5] https://www.theregister.com/2023/03/13/uk_industry_calls_for_autonomous/
[6] https://www.theregister.com/2017/11/09/self_driving_bus_crash/
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZDSHC6sTwufGViMkAHHu@AAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZDSHC6sTwufGViMkAHHu@AAAAJc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://static.nhtsa.gov/odi/rcl/2023/RCLRPT-23E029-4270.PDF
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZDSHC6sTwufGViMkAHHu@AAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://www.theregister.com/2022/07/18/cruise_cars_stopped/
[12] https://www.wired.com/story/dashcam-footage-shows-driverless-cars-cruise-waymo-clogging-san-francisco/
[13] https://whitepapers.theregister.com/
Re: Unique error
Which part of a bus being on a road in a busy city is the unique part?
Re: Unique error
The part where the bus is bendy.
Re: Unique error
Still seems easy concept that there's this large back end of a bus in front of you and you need to avoid running into the back of it.
The fact that there's some middle section which bends 30' further up the road seems neither here nor there.
Sounds like something in the basic AI model is missing. Rule 1 don't run into things. The fact that bendy buses might act a little different to other buses is a minor point.
Re: Unique error
> Had to disobey a red light ...
It would definitely be annoying to be stuck in an autonomous car with no where to legally go. On the other hand it could inform the fleet of the problem so all other autonomous vehicles route around the situation. Public transit has similar issues when buses break down or subways are temporarily stuck between stations, you just have to wait for help to arrive or the issue is resolved. Then again you could just abandon the car and catch a taxi, after all the car can find its own way home.
Unique error
The speed with which Cruise analysed and rectified the problem is impressive.
But I wonder how many other 'unique' situations these vehicles are going to encounter. I reckon that pretty much every time I go for a drive, I see some weird event that I've never encountered before. Some random recent examples:
(1) When joining a large motorway-junction roundabout, met a vehicle that was reversing back round the roundabout.
(2) Had to slow down to let a peacock cross in front of me.
(3) Had to go the wrong way round a traffic island because someone had parked in such a stupid place that I couldn't get through on my side.
(4) Had to disobey a red light at some roadworks, as it became obvious that the lights were stuck on red in both directions.
Really not sure how a self-driving vehicle would have handled any of those. And they're just a few examples.