Judges Are Fed Up With Lawyers Using AI That Hallucinate Court Cases (404media.co)
- Reference: 0176615965
- News link: https://yro.slashdot.org/story/25/03/04/2139203/judges-are-fed-up-with-lawyers-using-ai-that-hallucinate-court-cases
- Source link: https://www.404media.co/ai-lawyer-hallucination-sanctions/
> After a group of attorneys were [1]caught using AI to cite cases that didn't actually exist in court documents last month, another lawyer was told to pay $15,000 for his own AI hallucinations that showed up in several briefs. Attorney Rafael Ramirez, who represented a company called HoosierVac in an ongoing case where the Mid Central Operating Engineers Health and Welfare Fund claims the company is failing to allow the union a full audit of its books and records, filed a brief in October 2024 that cited a case the judge wasn't able to locate. Ramirez "acknowledge[d] that the referenced citation was in error," withdrew the citation, and "apologized to the court and opposing counsel for the confusion," [2]according to Judge Mark Dinsmore , U.S. Magistrate Judge for the Southern District of Indiana. But that wasn't the end of it. An "exhaustive review" of Ramirez's other filings in the case showed that he'd included made-up cases in two other briefs, too. [...]
>
> In January, as part of a separate case against a hoverboard manufacturer and Walmart seeking damages for an allegedly faulty lithium battery, attorneys filed court documents that cited a series of cases that don't exist. In February, U.S. District Judge Kelly demanded they explain why they shouldn't be sanctioned for referencing eight non-existent cases. The attorneys contritely admitted to using AI to generate the cases without catching the errors, and called it a "cautionary tale" for the rest of the legal world. Last week, Judge Rankin [3]issued sanctions on those attorneys, according to new records, including revoking one of the attorneys' pro hac vice admission (a legal term meaning a lawyer can temporarily practice in a jurisdiction where they're not licensed) and removed him from the case, and the three other attorneys on the case were fined between $1,000 and $3,000 each.
The judge in the Ramirez case said that he "does not aim to suggest that AI is inherently bad or that its use by lawyers should be forbidden." In fact, he noted that he's a vocal advocate for the use of technology in the legal profession.
"Nevertheless, much like a chain saw or other useful [but] potentially dangerous tools, one must understand the tools they are using and use those tools with caution," he wrote. "It should go without saying that any use of artificial intelligence must be consistent with counsel's ethical and professional obligations. In other words, the use of artificial intelligence must be accompanied by the application of actual intelligence in its execution."
[1] https://www.404media.co/ai-lawyer-hallucination-sanctions/
[2] https://storage.courtlistener.com/recap/gov.uscourts.insd.215482/gov.uscourts.insd.215482.99.0.pdf?ref=404media.co
[3] https://storage.courtlistener.com/recap/gov.uscourts.wyd.64014/gov.uscourts.wyd.64014.181.0_1.pdf?ref=404media.co
the application of actual intelligence (Score:3)
There you have it, the courts have ruled that AI is not actually intelligent. But you already knew that.
A measly fine? (Score:1)
That they'll make back in 2 hours? No. Disbarred immediately. JFC why haven't we implemented a rule for being caught doing shit like this? Oh yeah....the people who make the rules are giving AI sector full rein.
"Shepardizing" (Score:2)
This lawyer was failing in multiple ways. He clearly did not Shepadize his citations to ensure that they had not been overturned.
Headline is a lie as usual (Score:2, Redundant)
If you read the decision linked above, headline is the opposite of the ruling. Judge clearly states that using AI is not just fine, but probably the future of the profession.
What judge sanctions lawyers for is not fact checking findings of AI for hallucinations. I.e. AI that occasionally hallucinates and using it to draft documents is fine. Not checking the references to see if they're accurate or not is not fine.
Judges and lawyers both are terrified of AI (Score:2, Flamebait)
Judges and lawyers exist to apply extremely complex rules that themselves exist in order to get around Weasley attempts to avoid complying with laws by using language tricks.
AI has the potential to bust that wide open. An AI could find case law in seconds that you would normally pay tens of thousands of dollars for a lawyer to know about and leverage to win your case. They could find all the little tricks that you would pay a lawyer big bucks for and do it instantaneously. And they could apply complex r
Re: Judges and lawyers both are terrified of AI (Score:1)
You're the only one terrified of AI. Though it seems you're terrified of anything you don't understand.
Re: (Score:2)
An AI can clearly make up case law that doesn't exist in seconds.
Basing your legal defence on made up case law is pretty risky.
So right now all the effort (Score:2)
Is on replacing programmers and not lawyers. But that's going to change once they finish up with programmers. Better models will avoid creating case law and instead just find and summarize existing case law.
That said I think lawyers, unlike programmers, are smart enough to see when their jobs are at stake and aren't going to let it happen.
Re: (Score:2)
I think I've tried LLMs about 10 times over the past 1.5 years for code generation and questions. All of the code generation contained hallucinations, the tests generated both contained hallucinations and didn't provide meaningful tests, they failed to generate a working build, and every question it answered was wrong. To be frank, this doesn't surprise me if they used StackOverflow as a data source.
Maybe they'll improve but unless you suck as a developer you'll be better off with normal Google searches an
Never were, never will be. (Score:2)
> case against a hoverboard manufacturer
Sideways skateboards are not "hoverboards".
"In other words:" (Score:2)
> "In other words, the use of artificial intelligence must be accompanied by the application of actual intelligence in its execution."
Or, in laymen terms: "Stop being a dumbass and quit fucking up at your high-paying job, Mr. Attorney."
Er ... (Score:1)
... couldn't lawyers make up stuff manually before? I mean perish the thought, but I think it was in fact possible.
Re: (Score:2)
Of course, and if they got caught which they would, the punishment was a lot worse than a small fine. After all, if the opposing attorney is doing his job, he will check any cases cited in an opposing brief to determine what they actually say. What you are suggesting is fraud versus this which is merely incompetence.
Lazy, greedy assholes (Score:2)
I've done IT contracts for lawyers offices. They're all exactly as inept with technology, lazy, slow, and overpaid as you suspect they might be. I'm sure the top 10% of lawyers are efficient, smart, and great but not the rest! Using AI to do your job and not taking 5 seconds to see if a case actually exists when you're paying $200+/hr for them to do it? Someone should be disbarred.
Q: How do you save a lawyer from drowning? (Score:3)
A: Shoot him before he hits the water.
This joke is not fabricated using AI.
Re: (Score:2)
Like in anything else, a minority of lawyers are pretty good and know what they are doing. All those stupid lawyers would have to do is check if the cases really exist and review the cases. Just use the silly AI as hints which have to be verified. Same thing for any type of information really, it doesn't have to come from AI.