Man sues OpenAI claiming ChatGPT 'hallucination' said he embezzled money
- Reference: 1686243792
- News link: https://www.theregister.co.uk/2023/06/08/radio_host_sues_openai_claims/
- Source link:
Georgia resident Mark Walters filed the claim in Gwinnett County Court earlier this week. You can read a copy of Walters' complaint [1]here [PDF]. He alleges the chatbot is guilty of libel "per se," meaning a statement it made is likely to damage Walters' reputation.
"While research and development of AI is worthwhile, it is irresponsible to unleash a system on the public that is known to make up 'facts' about people," his attorney John Monroe told The Register
[2]
According to the complaint, a journalist named Fred Riehl, while he was reporting on a court case, asked ChatGPT for a summary of accusations in a complaint, and provided ChatGPT with the URL of the real complaint for reference. (Here's the [3]actual case [PDF] the reporter was trying to save time on reading for those curious.)
[4]
[5]
What makes the situation even odder is that the case Riehl was reporting on was actually filed by a group of several gun rights groups against Washington's Attorney General's office (accusing officials of "unconstitutional retaliation", among other things, while investigating the groups and their members) and had nothing at all to do with financial accounting claims.
When Riehl asked for a summary, instead of returning accurate information, or so the case alleges, ChatGPT "hallucinated" that Mark Walters' name was attached to a criminal complaint – and moreover, that it falsely accused him of embezzling money from The Second Amendment Foundation, one of the organizations suing the Washington Attorney General in the real complaint.
[6]
ChatGPT is known to "occasionally generate incorrect information" – also known as [7]hallucinations , as The Register has extensively reported. The AI platform has already been accused of writing obituaries for folks who are still alive, and in [8]May this year , of making up fake legal citations pointing to non-existent prior cases. In the latter situation, a Texas judge said his court would strike any filing from an attorney who failed to certify either that they didn't use AI to prepare their legal docs, or that they had, but a human had checked them.
It was all pretty bad news for junior lawyers who were hoping OpenAI's platform might do them a solid and claw a few minutes back from hours spent miserably sipping on cold coffee as they page through case law in a darkened office.
ChatGPT's maker, Microsoft-backed OpenAI, does [9]warn on its landing page that the platform is a "free research preview and not intended to give out advice." We have asked OpenAI for comment.
[10]
[11]AI needs a regulatory ecoystem like your car, not a Czar
[12]Scientists claim >99 percent identification rate of ChatGPT content
[13]Search engines don't always help chatbots generate accurate answers
[14]Air Force colonel 'misspoke' when he said an AI-drone 'killed' its human operator
According to the complaint, Riehl contacted Alan Gottlieb, one of the plaintiffs in the actual Washington lawsuit, about ChatGPT's allegations concerning Walters, and Gottlieb confirmed that they were false. None of ChatGPT's statements concerning Walters are in the actual complaint.
The false answer ChatGPT gave Riehl alleged that Walters was treasurer and Chief Financial Officer of SAF and claimed he had "embezzled and misappropriated SAF's funds and assets." When Riehl asked ChatGPT to provide "the entire text of the complaint," it returned an entirely fabricated complaint, which bore "no resemblance to the actual complaint, including an erroneous case number."
[15]
Walters is looking for damages and lawyers' fees. We have asked his attorney for comment. As for the amount of damages, the complaint says these will be determined at trial, if the case actually gets there.
We have asked experts in defamation for comment. According to the Berkman Center for Internet and Society, [16]in Georgia , a private figure plaintiff bringing a defamation lawsuit must "prove that the defendant was at least negligent with respect to the truth or falsity of the allegedly defamatory statements."
The complaint claimed "ChatGPT's allegations concerning Walters were false and malicious, expressed in print, writing, pictures, or signs, tending to injure Walters' reputation and exposing him to public hatred, contempt, or ridicule."
Internet defamation law firm RM Warner Law [17]opines that "it is the responsibility of slander and libel plaintiffs to prove that the statements under review are about them."
This part, in this Reg scribe's humble opinion, might be a problem. We have asked two Georgia-based Mark Walters for comment. ®
Bootnote
Walters' case, ironically, is listed in the [18]Gwinnett Courts Portal as Walters VS OpenAL LLC (23-A-04860-2). We can only assume the error was introduced by one of our fellow fleshbags.
Get our [19]Tech Resources
[1] https://aboutblaw.com/8ts
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZIJPfzDjUwx@z2dMkWgeFAAAAJY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://www.saf.org/wp-content/uploads/2023/05/Dkt-1-Complaint.pdf
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZIJPfzDjUwx@z2dMkWgeFAAAAJY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZIJPfzDjUwx@z2dMkWgeFAAAAJY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZIJPfzDjUwx@z2dMkWgeFAAAAJY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2023/04/26/is_your_ai_hallucinating/
[8] https://www.theregister.com/2023/05/31/texas_ai_law_court/
[9] https://chat.openai.com/
[10] https://regmedia.co.uk/2023/06/08/chatgpt_warning.jpg
[11] https://www.theregister.com/2023/06/07/ai_needs_a_regulatory_ecoystem/
[12] https://www.theregister.com/2023/06/08/scientists_ai_recognition/
[13] https://www.theregister.com/2023/06/07/search_engines_make_chatbots_inaccurate/
[14] https://www.theregister.com/2023/06/05/us_air_force_colonel_admits/
[15] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZIJPfzDjUwx@z2dMkWgeFAAAAJY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[16] https://www.dmlp.org/legal-guide/georgia-defamation-law
[17] https://kellywarnerlaw.com/georgia-defamation-laws
[18] https://odyssey.gwinnettcourts.com/Portal/
[19] https://whitepapers.theregister.com/
IANAL but it seems obvious to me that the suit should be against the journalist too lazy to do his own journalism....
I think this is more a case of "should I sue a smalltown hack, or a rich mega-global company"
Unless the journalist used a Macbook, then you could sue a $Tn company
Not really... OpenAI shouldn't put out "AI" that consistently spews complete bullshit, and thus, they're justly being sued for it.
The journalist is just guilty of believing it. Hopefully he learns a bit of skepticism.
And I don't see why we're calling it "hallucinations" - why are we sugar-coating it?
"Probably the first defamation suit involving an AI, but will it stick?"
Wasn't there an Australian case a few weeks ago? A small time politician / mayor / something of that kidney? Accused of being on the fiddle when he was allegedly the whistleblower?
Apart from which Mark Walters the thing is hallucinating about, there is also the question of who caused the publication of the allegedly defamatory material - is it OpenAI, or the journalist who ran the prompt? chatGPT wouldn't have produced the material if the journalist hadn't prompted it, after all.
This is not GPT.
It’s a stupid and lazy journalist who should be fired (like BoJo) for not even pretending to do their job.
And then sued.
Better to say nothing
Strictly speaking OpenAI has no idea who any particular individual is. There's likely to be many Mark Walters in the US so the only way that it could be associated with this particular one is if this one self-identifies. Which he has done.
Given AI's wide reach and ability to correlate enormous am0unts of information I'd keep relatively quiet and just say "not me, its screwed up again" (as we all know its prone to do). Making noise is drawing attention to one.....probably not a smart move.
Re: Better to say nothing
You appear to be correct. The only identification of "Mark Walters" given (in all the reports of this that so far found) was that he lives in Georgia and held a role at SAF.
The Mark Walters who is making the complaint is a radio talk host who doesn't claim to have held a post at SAF. If there is any actual reason to connect the two then it isn't being reported.[1]
This Walters wasn't even the first hit for a search on the name plus "Georgia" and when he does show up it is only due to this case. His pro-"gun rights"[2] radio show finally appeared after a bit of scrolling.
Given that, if there *is* a case to be made[3] it can surely only be againt the journalist, the only one who could be caught be the requirement he must "prove that the defendant was at least negligent with respect to the truth or falsity of the allegedly defamatory statements" (because, well, only a human can be negligent) then this looks to me like nothing more thsn an attempt to get publicity for his radio show.
[1] maybe Walters the radio host is is going to argue in court that he is a well-known embezzler, so it must be referring to him?
[2] guns have rights? But does he support the right for two guns of different calibre to co-habit in the same box? Won't somebody think of the ammunition!
[3] which I severely doubt
Yeah but ..
.. Chat GPT is on magic mushrooms,
It spews out stuff and when you point out the issues, confesses and generates 'alternatives' until you're happy or fed up.
For some things it's no better than the bollocksword generators we used to knock up in BASIC except that when people can't tell the difference it becomes much more insidious.
"According to the complaint, a journalist named Fred Riehl, while he was reporting on a court case, asked ChatGPT for a summary of accusations in a complaint, and provided ChatGPT with the URL of the real complaint for reference"
I thought ChatGPT wasn't able to go out on the Internet to look at stuff and could only reference what was in its database up to 2021? So the fact that this 'journalist' asked it to go and summarize a document on a URL it couldn't see meant it just made up whatever BS it wanted to and they never bothered to check it was correct.
Bingo.
Which is why suing OpenAI is ludicrous - given, from the article:
> Riehl contacted Alan Gottlieb, one of the plaintiffs in the actual Washington lawsuit, about ChatGPT's allegations concerning Walters, and Gottlieb confirmed that they were false.
So the only case for being negligent with the truth would be against Riehl, who either didn't bother learning the basic limitation of ChatGPT *and* contacted Gottlieb to late (basic lack of fact checking) or did so prior to promulgating the incorrect statements and went ahead anyway.
However, given that there is (so far reported) nothing to connect the non-existent Mark Walters to the gun-promoting radio host bringing the case, the whole thing is just a publicity stunt anyway, as Riehl is connected with another gun-related website, ammoland.com
Confusing article
I can't see anywhere this article says that the defamatory speech was published anywhere, and the essence of libel is that something needs to be published.
Unless I'm missing something this is just another "Chat-GPT can produce rubbish" story combined with a "some idiot doesn't understand libel but can find a lawyer who will still happily take their money" story, neither particularly newsworthy of themselves, and the mere juxtaposition doesn't improve the newsworthiness.
Re: Confusing article
> I can't see anywhere this article says that the defamatory speech was published anywhere
Confusing, isn't it?
Since posting (above) I've been doing a bit more searching and I think I'm going to have to change my opinion about the liability of "Fred Riehl"[1] - he *is* a lazy "journalist", as he likes to use ChatGPT to generate his "stories" (although he does admit that in the byline, so that is one thing in his favour[2]).
*But* as far as I can find out, Riehl never actually published any article containing defamatory statements, as we (including myself) have been assuming in the comments here. Instead, it currently looks like all that has actually happened is that Riehl asked ChatGPT and got back a response mentioning a *random* "Mark Walters" and in doing so, it was ChatGPT that was publishing this information!
Now, it appears that Riehl and *a* Mark Walters[3] are buddies in the "pro gun rights"[4] movement - Walters writes[5] for the website and his radio show has been promoted on the website - so *obviously* when ChatGPT talks to Riehl it must be referring to *that* Walters, hence ChatGPT has published defamatory statements about his colleague. All the contacting Gottlieb was to check the facts, just in case his Mark really was a wong'un - or more likely in order to be able to say to the world "look, even Riehl can manage to do this must due diligence, so ChatGPT must be really negligent".
So, ChatGPT is, apparently, "publishing" when it spits out a response and, despite having to retract my previous idea[6] about Riehl (for a new and even worst one, but hey), I still stand by my belief that this is all an attempt to get publicity for two otherwise totally pointless individuals and their ridiculous website and radio show.
[1] His own website and linkedin profile name him "Fredy Riehl" (having both "d"'s may have been too bourgeois for him)
[2] About the only thing so far; maybe he likes fluffy kittens as well?
[3] Hereinafter referred to as "the idiot doing the suing" M'lud
[4] Nope, already made that joke
[5] https://www.ammoland.com/author/markwalters/
[6] Science - we change our ideas as the evidence leads us
ChatGPT is known to "occasionally generate incorrect information"
IIUC, it is rather that it only generates pseudo-infomation; i.e. text or other content which might *seem* authoritative, but whose various constituent parts, if taken individually, might be true ... or not ... all according to some poorly characterized probabilities.
This sort of thing might be fine as a rough starting point, but it really does need to be checked and corrected in some way before it might be considered trustworthy.
ChatGPT hallucinates 100% of the time
Talking about LLMs, including ChatGPT:
> It’s not that they sometimes “hallucinate”. They hallucinate 100% of the time, it’s just that the training results in the hallucinations having a high chance of being accidentally correct.
A nice way of phrasing the problem, which I'm shamelessly nicking (sorry, I mean "am excerpting a portion of under Fair Rights[1]) from a discussion of this case over at https://reason.com/volokh/2023/06/06/first-ai-libel-lawsuit-filed/?comments=true
[1] Which is an US concept, but as it is a US website I'm ripping off - sorry, there I go again - and The Register now self-identifies as USazian I'm probably alright
Of course,,it would be utterly delicious if Chat GPTs summary was, actually, accurate. Grassed by AI