News: 1643635444

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Waymo sues California's DMV to block autonomous car crash data from publication

(2022/01/31)


In brief Waymo is suing California's Department of Motor Vehicles in an attempt to keep information about its autonomous car crashes and other operational details private, arguing that the data is a trade secret.

California's DMV is strict about giving permits to companies testing self-driving cars on real roads. Companies have to disclose operational and safety data before they're approved to drive in the state. But Waymo doesn't want that kind of information getting out.

The DMV received a request for public record of Waymo's self-driving car test permit application filed last year. Waymo sent the department a redacted version to give, but the person requesting the information challenged the redactions. The DMV then notified Waymo it was going to hand over the unredacted report unless the company "sought an injunction prohibiting disclosure of the material in unredacted form" by January 31, 2022, according to the lawsuit [1][PDF] .

[2]

If the data is made public, it "could provide strategic insight to Waymo's competitors and third parties regarding Waymo's assessment of those collisions from a variety of different perspectives, including potential technological remediation," the Google spin-off claimed in the court docs.

Should mental health crisis text conversations be used to train customer service chatbots?

A suicide hotline was slammed for sharing online text conversations with people seeking mental health support with its commercial spinoff to, erm, improve customer service AI chatbots.

Crisis Text Line, a global non-profit supporting those with mental problems, strips the data, removing any personally identifiable information, before it is given to Loris.ai, a startup focused on making customer service chatbots more empathetic. Crisis Text Line has a close working relationship with Loris.ai; it owns part of the startup and makes money from it. Both companies even had the same CEO at one point, [3]according to Politico.

[4]

[5]

Experts questioned whether it was right to share text data generated from vulnerable people for commercial purposes, even if it wasn't illegal. "The nonprofit may have legal consent, but do they have actual meaningful, emotional, fully understood consent?" said Jennifer King, the privacy and data policy fellow at the Stanford University Institute for Human-Centered Artificial Intelligence.

A volunteer who has spent hundreds of hours helping Crisis Text Line said she wasn't aware the non-profit was sharing people's sensitive conversations. "Mental health and people cutting themselves adapted to customer service?" said Beck Bamberger. "That sounds ridiculous. Wow."

OpenAI trains new language models more aligned with humans

Researchers at OpenAI have developed InstructGPT, a new class of language model that promises to better understand user intentions and follow instructions to generate more relevant text.

For example, given the prompt: "Explain the moon landing to a six-year-old in a few sentences." OpenAI's previous GPT-3 model would spit out: "Explain the theory of gravity to a six-year-old. Explain the theory of relativity to a six-year-old in a few sentences. Explain the Big Bang Theory to a six-year-old." GPT-3 is good at regurgitating the structure of a given prompt to complete sentences.

[6]

InstructGPT, however, replied: "People went to the Moon, and they took pictures of what they saw, and sent them back to the Earth so we could all see them."

This output is arguably more useful than the previous one. OpenAI said it trained InstructGPT by using reinforcement learning algorithms to rank a dataset annotated by humans studying the quality of GPT-3's replies from given prompts.

"The resulting InstructGPT models are much better at following instructions than GPT-3. They also make up facts less often, and show small decreases in toxic output generation," OpenAI said in a blog post. "Our labelers prefer outputs from our 1.3B InstructGPT model over outputs from a 175B GPT-3 model, despite having more than 100x fewer parameters."

GPT-3 Embeddings by [7]@OpenAI was announced this week.

📈 I was excited and tested them on 20 datasets

😢 Sadly they are worse than open models that are 1000 x smaller

💰 Running [8]@OpenAI models can be a 1 million times more expensive [9]https://t.co/vY1rsakLZM [10]pic.twitter.com/cRGM1upVCJ — Nils Reimers (@Nils_Reimers) [11]January 28, 2022

InstructGPT is now the default class of models offered via OpenAI's API. But one natural language processing researcher from Hugging Face, Nils Reimers, found that InstructGPT performed worse than many smaller open source models across a range of tasks, including text retrieval or search. ®

Get our [12]Tech Resources



[1] https://regmedia.co.uk/2022/01/28/waymo_california_dmv_lawsuit.pdf

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YfgVuFSJDsEB7uoGUSrtqgAAAEI&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://www.politico.com/news/2022/01/28/suicide-hotline-silicon-valley-privacy-debates-00002617

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YfgVuFSJDsEB7uoGUSrtqgAAAEI&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YfgVuFSJDsEB7uoGUSrtqgAAAEI&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YfgVuFSJDsEB7uoGUSrtqgAAAEI&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[7] https://twitter.com/OpenAI?ref_src=twsrc%5Etfw

[8] https://twitter.com/OpenAI?ref_src=twsrc%5Etfw

[9] https://t.co/vY1rsakLZM

[10] https://t.co/cRGM1upVCJ

[11] https://twitter.com/Nils_Reimers/status/1487014195568775173?ref_src=twsrc%5Etfw

[12] https://whitepapers.theregister.com/



Dwarf

The only conclusion we can draw from the Waymo response has to be that they have something to hide. If you look at the aviation industry, they actually learn from the mistakes and make improvements. This sort of learning should be available across all autonomous vehicle companies so that each doesn't have to make the same mistakes.

On the AI point - using mental health conversations to teach AI - Didn't anyone learn anything from when Microsoft tried this with their Tay chatbot ?

Its no longer the voices in my head, now the chatbot told me to do it ...

Seems to be a trend here about people not joining up the dots and learning from other people's mistakes.

ComputerSays_noAbsolutelyNo

In a me-centric world, why learn from other people's mistakes?

What they really mean

Dave 15

Is that there have been a number of accidents created by badly written and designed systems at least as embarrassing as the mess Tesla is using and they dont want the humiliation to be out there

"the data is a trade secret"

Pascal Monett

Not if the accident happened on a public street it aint.

Not if you had to report it to the authorities.

That is public information and I hope the judge is going to throw that lawsuit out with prejudice.

Artificial Crowd Intelligence

ThatOne

> They also make up facts less often, and show small decreases in toxic output generation

Wow, let's hope the average Internet user will soon be upgraded to that class.

Answer is easy

Helcat

Terms and conditions of the permit is the data has to be made public.

Don't want to make it public? No permit.

It really is that simple.

Re: Answer is easy

Doctor Syntax

Cake and eat it situation. Perhaps they're keeping a seat ready for BoJo in the board room.

un believable

Prst. V.Jeltz

After all the debate about should we ? can we ? how do we test it ?

Waymo think the best way is to keep the test results secret?

maybe im being naive , but If I were in charge complete transparency would be absolute rule number one , above all others .

I wish it were that easy

Sleep deprived

You mean Waymo clicked on the "I read and accept the terms of agreement" in order to get a permit and they now want to unclick or change said terms? I wish it were that easy...

Should mental health crisis text conversations be used to train customer service chatbots?

Lotaresco

Stuff that noise. Should chatbots even be the first contact that a person with a mental health crisis encounters when searching for help?

Betteridge's Law applies.

Having encountered chatbots in various guises, I have to say that they can drive even someone who is coping well and has a supportive network to harbour intense, dark thoughts after just a half-hour of nonsense. People who are having a mental health crisis need an understanding, empathetic, human being to talk to. Not a bl**dy chat bot.

I know how to do SPECIAL EFFECTS!!