Apple called on to ditch AI headline summaries after BBC debacle
- Reference: 1734716193
- News link: https://www.theregister.co.uk/2024/12/20/apple_ai_headline_summaries/
- Source link:
Reporters Without Borders (RSF) [1]said this week that Apple's AI kerfuffle, which generated a false summary as "Luigi Mangione shoots himself," is further evidence that artificial intelligence cannot reliably produce information for the public. Apple Intelligence, which launched in the UK on December 11, needed less than 48 hours to make the very public mistake.
"This accident highlights the inability of AI systems to systematically publish quality information, even when it is based on journalistic sources," RSF said. "The probabilistic way in which AI systems operate automatically disqualifies them as a reliable technology for news media that can be used in solutions aimed at the general public."
[2]
Because it isn't reliably accurate, RSF said AI shouldn't be allowed to be used for such purposes, and asked Apple to pull the feature from its operating systems.
[3]
[4]
"Facts can't be decided by a roll of the dice," said Vincent Berthier, head of RSF's tech and journalism desk. "RSF calls on Apple to act responsibly by removing this feature.
"The automated production of false information attributed to a media outlet is a blow to the outlet's credibility and a danger to the public's right to reliable information on current affairs," Berthier added.
[5]
It's unknown if or how Apple plans to address the issue. The BBC has [6]filed its own complaint, but Apple declined to comment to the British broadcaster publicly on the matter.
According to the BBC, this doesn't even appear to be the first time Apple's AI summaries have falsely reported news. The beeb pointed to an Apple AI summary from November [7]shared by a ProPublica reporter that attributed news of Israeli prime minister Benjamin Netanyahu's arrest (which hasn't happened) to the New York Times, suggesting Apple Intelligence might be a serial misreader of the daily headlines.
[8]Meta warns bit flips, other hardware faults cause AI errors
[9]How deliciously binary: AI has yet to pay off – or is transforming business
[10]LinkedIn: If our AI gets something wrong, that's your problem
[11]Reddit rolls out AI-powered 'Answers' search feature, redditors don't rejoice
Google's AI search results have also been tricked into [12]surfacing scam links , and have also urged users to [13]glue cheese to pizza and eat rocks .
Berthier stated, "The [14]European AI Act - despite being the most advanced legislation in the world in this area - did not classify information-generating AIs as high-risk systems, leaving a critical legal vacuum. This gap must be filled immediately."
The Register has reached out to Apple to learn about what it might do to address the problem of its AI jumping to conclusions about the news, and RSF to see if it's heard from Apple, but we haven't heard back from either. ®
Get our [15]Tech Resources
[1] https://rsf.org/en/rsf-urges-apple-remove-its-new-generative-ai-feature-after-it-wrongly-attributes-false-information
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Z2X3E3KFsntpXb-3spwPVwAAAMg&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z2X3E3KFsntpXb-3spwPVwAAAMg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Z2X3E3KFsntpXb-3spwPVwAAAMg&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z2X3E3KFsntpXb-3spwPVwAAAMg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://www.bbc.com/news/articles/cd0elzk24dno
[7] https://bsky.app/profile/schwanksta.com/post/3lbi6rxhigc2r
[8] https://www.theregister.com/2024/06/21/hardware_faults_create_inferencing_errors/
[9] https://www.theregister.com/2024/07/30/ai_has_yet_to_pay/
[10] https://www.theregister.com/2024/10/09/linkedin_ai_misinformation_agreement/
[11] https://www.theregister.com/2024/12/09/reddit_ai_answers_search_feature/
[12] https://www.theregister.com/2024/03/25/googles_aipowered_search_results_are/
[13] https://www.theregister.com/2024/05/31/google_ai_search_update/
[14] https://www.theregister.com/2024/05/21/prepare_your_audits_eu_commission/
[15] https://whitepapers.theregister.com/
The classical twist of blame here isn't it? The next problems, that it cannot be distinguished at a glance with a clear mark, that it is enabled without warning and so on... There is always a way to twist it victim blaming...
That's fair for Apple's interest in sending random news headlines to iPhones that never asked for it. Those were often irrelevant, but at least they were true. Users can turn those off when they realize how they don't need them.
Making up headlines and sending those is much worse, and unhappiness with Apple is completely justified, especially for the reporters given credit for the false statements. Consider your reaction if you were working in an office and the person next to you frequently shouted inaccurate statements at you about things you needed to check. Yes, you could and would eventually ignore them, but it wouldn't be your fault if you wasted your time checking out one of those inaccurate statements, the problems caused by any reaction would be their fault, and someone in management might well tell them to stop doing that. We can't make Apple stop doing that, but we have lots of reasons to want them to. Asking users to turn the thing off is not good enough.
It's garbage
It isn't up to users to turn it off.
Almost all this kind of so called AI needs scrapped.
It's dishonestly promoted.
It's producing garbage when not plagiarising.
The environmental cost is too high.
Make it illegal, fine companies 10% of annual turnover if they deploy it,
Nuke it from orbit!!
Re: It's garbage
Oh no, the AI method of neurological networks and their current implementation is fine. The problem arises from applying it to things where they don't work and ignoring that they don't work.
A huge amount of AI is used in material research, component optimizing and so on, saving time and money there - and actually saving energy too in the end. But that does make it to the news, and is not abuse-able for marketing "Yay Notepad Need AI Too Yay!"
Re: It's garbage
They demonstrably don't work in some situations. In that case how do you determine the boundary between those areas where they do work and those where they don't? If you have a hundred or a thousand instances of a system working correctly how can you be certain the next one - or hundred or thousand will still be OK?
Re: It's garbage
Where's my (BBC) Minority Report!
Re: It's garbage
Just treat it as something that is considered to be deployed by the most senior executive of a company. Hold them- or the entire C-suite- legally responsible.
We know LLMs are poor at summarising
LLMs keep demonstrating that summarising is their weak spot. They can shorten but, because they are inherently stupid and they have no idea what they are doing, these "AI" implementations are unable to distinguish the important from the not important. And that's key for summarising.
[1]When ChatGPT summarises, it actually does nothing of the kind.
[2]AI worse than humans in every way at summarising information, government trial finds
[1] https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actually-does-nothing-of-the-kind/
[2] https://www.crikey.com.au/2024/09/03/ai-worse-summarising-information-humans-government-trial/?utm_source=pocket_shared
With hindsight it is truly amazing that News of the World could generate totally bogus news, while drawing less than 50kW of power to do so.
If Apple switches to an AI summary of NotW and The Onion, will it be filled with truths?
Irony overload.
Not sure what the NotW has to do with the price of fish, but
"Facts can't be decided by a roll of the dice," said Vincent Berthier, head of RSF's tech and journalism desk. "RSF calls on Apple to act responsibly by removing this feature.
"The automated production of false information attributed to a media outlet is a blow to the outlet's credibility and a danger to the public's right to reliable information on current affairs," Berthier added.
Rolling the dice is how the Bbc gets most of their 'climate' stories, except the automated production of false information is generated by models rather than AI. Not that the Bbc has any climate 'scientists' on staff to 'fact check' their false information, and so their credibility is blown. The public should have a right to reliable information, but generally don't get that from the MSM and their fellow travellers.
Re: Irony overload.
Just a quick example for those that prefer fake news-
https://www.bbc.co.uk/news/articles/cgl9yk42rz7o
Storm Darragh brought 96mph gusts on Saturday, with two men dying during the storm and thousands being left without power. It was the fourth serious storm to hit the UK since mid-October.
This was the 'extreme weather' which insurers are refusing to pay claims on because according to them, winds didn't exceed the 55mph to qualify as a severe storm. By contrast, this is a couple of years old now, but..
https://www.metoffice.gov.uk/research/news/2021/recent-trends-and-future-projections-of-uk-storm-activity
... there is nothing to suggest maximum wind speeds have persistently changed in recent decades.
The only '96mph gusts' were recorded at Berry Head near Torbay, where the weather station's sitting on a hill fort here-
https://en.wikipedia.org/wiki/Berry_Head
So I rather doubt there'll be starter homes built there, although Pinchbeck would probably recommend building windmills.
Re: Irony overload.
So which part of that article is the fake part? That wind speeds reached their number? No, you cited that source. It might not have reached that number at the location where peoples' houses are, or insurance companies may have lied about whether it did to avoid paying a claim, but the article did not say "Storm Darragh brought 96mph gusts to literally every area inside the storm on Saturday,". So maybe they lied about the statement made by Ms. Pinchbeck and she never said what they quote her as saying? Maybe, but it doesn't seem likely.
So I think all we have is that you're saying that Pinchbeck is wrong, which doesn't make the article fake even if it is true. Also, it isn't proved about what she said, because she did not claim that wind speeds have increased. She advises preparation for more heat and more flooding. Is there more heat and more flooding? You could try to prove that there isn't, but you haven't even attempted it. Even if you did, the most you can hope to demonstrate is that Pinchbeck is wrong or lying, not that the article is fake. You can try to claim that her statement about flooding is misleadingly linked with a storm with high winds, but as that storm also prompted several flood alerts and one flood-related death, it's unlikely to be that misleading to talk about both the wind and flood damage in one article.
Re: Irony overload.
It's so fake the BBC wrote an article headline the strength and location of the highest gust during the storm, before going on list the damage caused by the storm:
[1]96mph gust recorded at height of Storm Darragh
Are you unaware that weather data records record both the highest gust and the average speed? Did the damage not happen or something? Christ on a bike, it's all so fucking tiresome. The Internet is a foghorn to blithering idiots.
[1] https://www.bbc.co.uk/news/articles/cy7kk7ny7kmo
Re: Irony overload.
It's a shame that the UK squandered it's lead on AI to Apple
Once upon a time, the Daily Mail, Sun, NotW, etc were able to generate totally fake news stories with artificial intelligences powered only by beer, fags and a slavish devotion to the editor
The [1]suggestion by Google's "AI Overviews" to eat one rock a day for a health reasons was actually lifted directly from [2]an article in the Onion .
[1] https://theconversation.com/eat-a-rock-a-day-put-glue-on-your-pizza-how-googles-ai-is-losing-touch-with-reality-230953
[2] https://theonion.com/geologists-recommend-eating-at-least-one-small-rock-per-1846655112/
"APPL shares tank after researchers confirm Chinese backdoor in all products since 2013"
If Apple are allowed to push untrue content from their lying AI without any consequences everyone should be allowed to push untrue content from their lying BS generators without consequences
if, in this post truth world, lies are free speech, and we have to put up with lies as alternative facts, we should embrace that, produce our own, take it to the extreme. It costs almost nothing compared to building an actual AI, it can be a few lines of python code, can run on a raspberry pi.
Taking the moral high ground won't save us from this sinking ship of shit so we might as well help it hit rock bottom as soon as possible.
Re: "APPL shares tank after researchers confirm Chinese backdoor in all products since 2013"
Here's some more fake headlines :
"Tim Cook dead at age 56"
"Apple to give away free Iphones for christmas at all Apple stores !"
"Personal details of millions of Iphone users leaked on the dark web"
"Tim Cook stepping down as CEO of Apple"
"Tim Cook to legally change his name to Tim Apple"
Re: "APPL shares tank after researchers confirm Chinese backdoor in all products since 2013"
Shirley you meant Pyne Apple .... ?
glue cheese to pizza and eat rocks
I stopped by a well known burger flinger on the way home from work because it's been a bit of a shit day and I just want to stare at the wall rather than get up off my arse and cook stuff.
Arguably the cheese is some sort of yellow glue, and to be honest I'm thinking there might be more nutritional value in rocks. At least the chips were hot for a change. Hot chips are nice, cold chips (the usual kind) are a sort of grim that would be a torture in hell (you can have all the chips you want in the afterlife, but they're the cold congealed manky ones that should have been thrown out half an hour ago...).
Re: glue cheese to pizza and eat rocks
IIRC those sorts of restaurants in France sell beer as well, so some things are still ok.
SWMBO asked one of these monstrosities to summarize a research paper on ivermectin and hydroxychloroquine, for $WORK. The summary said that they are effective for treating COVID. That’s… not what the study said.
The whole LLM thing needs to be scrapped. It’s a dead-end.
Its not a dead-end, its a roundabout.
Eventually it will libel
someone very rich.
(We need a popcorn icon)
Apple declined to comment ...
Why should they comment? Other than to send a polite "Thank you" to the BBC for being so complimentary about Apple's services.
At least, that is what the Apple PR flacks believe, after they read the Apple Intelligence summary of the Beeb's communication (hey, those are busy and important flacks, they don't have time to read it all themselves; those lunches won't eat themselves).
"This accident highlights the inability of AI systems..."
It's not an accident. They didn't accidentally roll out a headline summary bot. They didn't accidentally fail to verify that an LLM was the right tool for the job. They didn't accidentally fail to check the bullshit output before publishing it.
Turn it Off, or don't enable it from the start.
It's not that hard. Why are people so hell bend on being just... stupid and lazy.