Driver in Uber's self-driving car death goes on trial, says she feels 'betrayed'
- Reference: 1647263945
- News link: https://www.theregister.co.uk/2022/03/14/in_brief_ai/
- Source link:
Vasquez was the driver when one of Uber's autonomous test cars [1]crashed into a woman walking her bike across the road at night in March 2018. Now nearly three years later, she is due to go on trial for negligent homicide and has spoken out for the first time.
"I feel betrayed in a way," she [2]told Wired. "At first everybody was all on my side, even the chief of police. Now it's the opposite. It was literally, one day I'm fine and next day I'm the villain. It's very – it's isolating."
[3]
Meanwhile Uber has escaped any criminal liability, whilst Vasquez is being sued by prosecutors in Arizona. The blame has been pinned squarely on the driver when videos of her showed she was distracted before the collision. Her defense team will argue she was checking Slack messages from Uber in her work phone at the time, whilst prosecutors will say she was watching an episode of reality show The Voice on her personal handset.
[4]
[5]
Whatever the outcome of the case, Vasquez's side of the story is a tragic, personal tale of some of the risks in pursuing a high-tech, automated future.
Clearview faces more fines, this time in Italy
Clearview AI was fined €20m ($21.8m) by Italy's data protection watchdog for unlawfully scraping selfies from local citizens for its controversial facial recognition software, violating Europe's General Data Protection Regulation (GDPR) rules.
"The findings revealed that the personal data held by the company, including biometric and geolocation data, are processed illegally, without an adequate legal basis, which certainly cannot be the legitimate interest of the American company," the Garante per la Protezione dei Dati Personali [6]said in a statement this week.
Clearview's CEO Hoan Thon-That admitted to downloading billions of photos from social media sites like Facebook or Instagram. The company uses this to build a database so its facial recognition algorithm can try and find matches to identify people from CCTV or a photograph.
[7]
Thon-That [8]told TechCrunch that Clearview did not operate in Italy, and that all the data it scraped from the internet is public. It will be difficult for Italy's data security agency to force the company to pay up, but the decision could deter Italian companies from using Clearview's software.
Can AI make critical military decisions?
US government defense research lab, DARPA, has announced a new program looking at how algorithms could help make "critical decisions" during military operations.
Imagine a scenario where two soldiers in combat can't quite agree on how to proceed with a particular task, a machine could help them with their conundrum so they can work together. DARPA is interested in developing these types of AI algorithms in a project named "In the Moment" (ITM).
"ITM is different from typical AI development approaches that require human agreement on the right outcomes," [9]said Matt Turek, ITM program manager. "The lack of a right answer in difficult scenarios prevents us from using conventional AI evaluation techniques, which implicitly requires human agreement to create ground-truth data."
ITM is going to run for 3.5 years, during which researchers will identify what types of problems its decision-making algorithms can tackle, and collect a lot of data on how humans might make those decisions themselves. Researchers will then create a "quantitative alignment score" to see how far away from the average its algorithms answers are from the human responses.
[10]
Finally, the agency will consult legal counsel and experts in ethics to see how these systems can be used practically in the real world. ®
Get our [11]Tech Resources
[1] https://www.theregister.com/2018/03/19/uber_self_driving_car_fatal_crash/
[2] https://www.wired.com/story/uber-self-driving-car-fatal-crash/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Yi90uEMDqW5eJAruFN-JKgAAAEg&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yi90uEMDqW5eJAruFN-JKgAAAEg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yi90uEMDqW5eJAruFN-JKgAAAEg&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.garanteprivacy.it/home/docweb/-/docweb-display/docweb/9751323
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Yi90uEMDqW5eJAruFN-JKgAAAEg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://techcrunch.com/2022/03/09/clearview-italy-gdpr/
[9] https://www.thedefensepost.com/2022/03/08/darpa-algorithm-military-decision/
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Yi90uEMDqW5eJAruFN-JKgAAAEg&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[11] https://whitepapers.theregister.com/
Re: Who cares....
Exactly. She was supposed to be driving, not ignoring everything in favour of burying her nose in her SmartPhone. It doesn't matter what she was doing on it, that she was *not* paying attention to the road is the crux of it all.
ClearView needs to be bitch slapped with a fine that will not just be a cost of doing business, it should be severe enough to make their bottom line bleed like a freshly butchered pig. A mere 20M is chump change. Turn that M into a B to make them take it seriously enough to not want to do it again. Turn it into a T to make their shareholders take down the entire C-level bunch of prats with pitchforks, burning tar, & bags of feathers.
Re: the crux of it all.
Surely the crux of it all is that expecting humans to pay continuous and close attention to something that only relatively rarely requires them to actually *do* anything is, even at best, optimistic. It seems to me like the "safety driver" is only there to provide someone to blame who *isn't* the company claiming to be testing a "self driving car".
IMO, regardless of the situation, the company should be just as much on the hook for reponsibility as the "safety driver" employee. Because either the company hired someone not up to the task (i.e. the company's fault, as well as - possibly - the employee's for being negligent), or they gave the employee a job that couldn't be performed to an adequate standard (i.e. the company's fault).
Re: the crux of it all.
Absolutely. On the one hand she's got no right to say she was "betrayed", she should have been paying attention. On the other hand, after you've been sitting behind the wheel doing nothing for hours and hours, after a while it's human nature to get a bit bored and trust that the thing is doing a good job of driving itself. (perhaps not if you are an engineer - but just a mere human).
Should we learn something from this, and put in some safety measures that make sure the "safety driver" is truly paying attention? Some combination of carrot and stick?
Re: some safety measures that make sure the "safety driver" is truly paying attention?
Perhaps if we asked them to actually drive the car? :-D
Re: Who cares....
"Turn it into a T to make their shareholders take down the entire C-level bunch of prats with pitchforks, burning tar, & bags of feathers."
The shareholders are equally reprehensible for investing in this antisocial crap. Don't let them escape the the tar and feathers.
Re: Who cares....
There's a long article on Vasquez and the accident at https://www.wired.com/story/uber-self-driving-car-fatal-crash/. Complicated situation. For example, Vasquez claims she was Listening to The Voice, not Watching it. And the pre-crash dash camera video might well support that. Listening to a broadcast seems OK and was also permitted by Uber's "driver's" rules. On the other hand, there is some reason that the authorities decided to charge her but not Uber, and I'd like to hear their side of the story.
BTW, the article does not reflect all that well on Uber. On the positive side, they did have rules and the cooperated in the investigation. On the other hand, it sounds like their "self-driving" software might be awful. Even worse than Tesla's -- assuming that is possible. And they disabled the vehicle's collision avoidance system which might have worked. And their system clearly was not designed with "If you must make mistakes, error on the side of safety" in mind.
Re: Who cares....
"there is some reason that the authorities decided to charge her but not Uber"
That would be because at the time, she was legally in control of the vehicle.
Re: Who cares....
What's the betting they told her it was a "self driving car" and she didn't have to "do anything" (especially not look at clause 475)
Reg readers probably all know otherwise, but I don't blame someone for thinking that a self driving car can drive itself.
Be nice to know how much training she got, if any.
Perhaps we need a driving licence for using self driving cars? And to stop calling them that, since they ain't and maybe maybe never will be.
pretty cold and dark thought...
Could it even be in the vaguest realms of possibility that they would deliberately put someone in their car and instruct them or misguide them as to the level of interaction required, knowing that this was a likely outcome and that, in fact, what their "experiment" was intended to do was not so much to test the car but to test the legal system?
Re: Who cares....
You must not have see the video screen shots that were released. That date where she says that everyone went from supporting her to hating her was, in fact, the day the images were relesed showing her staring down at the phone in her lap. If she was only listening to The Voice its only because her phone was in split-screen mode and she was sending a text message.
Re: Who cares....
According to the Wired story -- which may not be an unbiased source. What she was looking down at was her work phone on the console which was displaying work related slack messaging. (Seems to me like a bad idea BTW. If reading messages while driving really is part of the job, surely the phone should be mounted on the dash or in the upper left corner of the windshield). According to Wired, her personal phone showing/playing The Voice was on the passenger seat. And -- according to Wired -- the dash video shows her reaching over there to get the phone to dial 911 after the accident.
Re: Who cares....
I remember seeing the video of the crash when it first happened.
Yes the driver didn't have her eyes on the road, but on the camera footage I couldn't see the pedestrian until the last second. Blink and you're too late.
My conclusion at the time was that the woman and bicycle were clearly in the wrong, and that that type of accident must happen all the time without anyone being sent to jail.
Uber or any other self-driving test organisation should be obliged to take out a special insurance to pay big money to anyone who manages to get hit by one of their cars. That would make them more risk aware..
Re: Who cares....
"the woman and bicycle were clearly in the wrong"
*sarcasm* Obviously deserved a death sentence then. */sarcasm*
In order to assert that accidents of that type must happen all the time, you have to ascertain how may incidents of that type don't become accidents of that type due to the presence and active response of a reasonably vigilant driver.
It would be impossible to prove beyond any doubt that had the driver been paying attention, the outcome of the event would have been different. It is similarly impossible to prove that it wouldn't have been any different.
It would be even harder to determine if the the driver HAD been paying attention that they would have taken action to avoid the outcome, seeing as though they were in a vehicle that supposedly would avoid such incidents of its own volition. In a way, I wish that this was in fact the case being tested. This will be an easy one... she wasn't paying attention, she didn't see the woman, she's liable. The harder case, and the one that puts the ball firmly in the court of the developer, is if the driver HAD seen the woman but the vehicle's control system either hadn't the sensor data to label it or if it had, that the vehicle's system would have taken avoidance action about it. How's a supervising driver supposed to know if something has been detected or not and if it has, how has it been classified? It's all well and good showing these videos of objects with green cuboids around them and vector arrows attached to them, but these aren't displayed in the vehicle, are they?! Superimposed over all the windows to show what the vehicle's view of the world is? We don't get to see a stream of machine code down the side labelling the possible responses and highlighting the selected response.
You've clearly got to have no fear or respect for your own life, let alone anyone else's to sit in a self drive car without being the slightest bit worried about what's going on outside. Or she was too trusting of the technology, which is an equally insane state of mind.
This is entirely her fault so far as I'm concerned. You're sat there in a moving vehicle and you're meant to intervene if things go wrong. You can't do that if you can't be bothered to look anywhere but your phone.
Software to arbitrate between two soldiers -- haven't they heard of rank?
Don't really don't get this one, you don't have time in combat to make decision making protracted so usually the army has very clear hierarchy such discussions usually end with yes sarg or sir not lets boot my laptop and see what the AI thinks once everything is entered in.
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
"Hello Dave, how can I help you today?"
"I see. You want me to advise on how best to attack that advancing tank."
"I must advise you Dave that there is only a 37.2 per cent chance of completing this conversation before the tank is on top of you."
"Would you like me to sing Daisy Daisy to take your mind off the pain of having been run over?"
"Dave?"
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
If you are infantry in a proper foxhole, you're supposed to let the tank run over you. That lets you either attack its more vulnerable areas or attack the infantry supporting the tank. That is, if the Russians sent in supporting infantry with their tanks....
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
Sarg? where is the option to tick if there isn't a foxhole?
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
Sarge: You go out and have a look!
Grunt: No way! I'll probably get shot.
Sarge: Let's ask the AI
AI: You both go
[calculates: one will come back, wages will be reduced, savings made on rations]
Same applies when going to the doctors. Doc will give you a prescription based on cost /benefit across the whole population. It's your own responsibility to see it that maximises your own utility.
It's usually worth trying alternative medicine (é.g diet change, hippie shit) because it's cheap and does not have contraindications with the drugs Doc gave you (you should take these, natch). Usually worth seeing if there are other relevant drugs which don't have contraindications and taking them too.
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
We seem to be stuck in a foxhole in the ground underneath a giant tank that we can't possibly move with no hope of rescue. Does the AI battle computer have anything to say about that?
Yeah. There's bound to be something... Just got to fill in the right... Ah! Here it is...
What to do if you find yourself stuck in a foxhole in the ground underneath a giant tank you can't move, with no hope of rescue. Consider how lucky you are that life has been good to you so far. Alternatively, if life hasn't been good to you so far, which given your current circumstances seems more likely, consider how lucky you are that it won't be troubling you much longer.
It's about time we did something about that AI.
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
Clippy goes to war? Doesn't sound promising.
Re: Software to arbitrate between two soldiers -- haven't they heard of rank?
> Clippy goes to war? Doesn't sound promising.
It looks like you're trying to order a man to his death. Can I help you with that?
What year is it?
It says, "... March 2018. Now nearly three years later ..."
The past few years have been very disorientating and I'm not sure the months in lockdown really count but technically, about four years have passed since March 2018.
> Finally, the agency will consult legal counsel and experts in ethics
Ah yes, spend the time and money, and only *then* worry about whether it's legal. (I expect that the "experts in ethics" bit is dry humor.)
"At first everybody was all on my side, even the chief of police."
Yup that's pretty typical for a driver running down pedestrians and people on bikes. Officer will take the motorist's statement while the person on the ground is wheeled off to the hospital or morgue. Won't even take the statement of a survivor before filing the paperwork. Might even go on camera to advocate on the driver's behalf. For the victims the burden of proof is often on them, and often requires media coverage to generate enough outrage for a real investigation to occur.
Also, since the universal rule is "don't talk to the police, because they see it as their job to get you to confess to everything" I have to wonder if the Chief of Police was actually on her side of it just felt that way while they talked in hopes of getting her to say something they could later use against her in court.
Tragic?
-> Vasquez's side of the story is a tragic, personal tale
Even more tragic for the person who was killed, who in this report is merely 'a woman'. Nameless.
GDPR?
I thought the GDPR was EU-wide so if they are fined in Italy for breaching it then they can't do any business elsewhere in the EU without paying up?
Re: GDPR?
Clearview AI was fined €20m ($21.8m) by Italy's data protection watchdog for unlawfully scraping selfies
Lucky they just got $30M in extra funding [1] last October . /sarc
[1] https://www.theregister.com/2022/03/14/ukraine-clearview-facial-recognition-war/
The Moment
Am I the only one to think of that [1]ultimate weapon used - or not used - by The Doctor?
M.
[1] https://tardis.fandom.com/wiki/The_Moment
"It will be difficult for Italy's data security agency to force the company to pay up, but the decision could deter Italian companies from using Clearview's software."
GDPR has options for holding officers of the company responsible. I think an extradition request for the CEO, CFO and directors for non-payment of the fine would produce quick results.
Self driving ?
Any vehicle manufacturer that claims self / autonomous driving abilities is clearly defrauding.
None of them can be trusted. All require a pilot. So what good are they ? Ill take the wheel..
"I feel betrayed in a way,"
Well your victim is dead.
Who is worse off, again ?
Cry me a river. I was never on your side. You were THE DRIVER.
YOU were responsible.
It's time to own up to that.
Who cares....
"Her defense team will argue she was checking Slack messages from Uber in her work phone at the time, whilst prosecutors will say she was watching an episode of reality show The Voice on her personal handset."
It doesn't really matter which, it matters whether either of these was considered acceptable whilst being the legally responsible driver in a vehicle.
If checking slack is something which was accepted, or even expected, by her employers then that is a serious issue.
She was a safety driver, not a systems engineers meant to be heads down doing other work whilst the vehicle was in motion.