Publisher breaks news by using bots to write inaccurate stories
- Reference: 1674106326
- News link: https://www.theregister.co.uk/2023/01/19/cnet_reviewing_ai_authored_stories/
- Source link:
The masthead quietly began using a text-generation tool to write stories for its money section in November 2022. The articles credit "CNET Money Staff", but readers were not told that byline refers to an artificial author whose work was edited by humans until they hovered over the byline's text.
Editor in Chief Connie Guglielmo said the site now attributes the stories to "CNET Money". A total of 78 articles so far contain text generated by AI and discuss personal finance-related topics such as credit scores, and home equity loans.
[1]
Guglielmo said CNET experimented with AI software "to see if the tech can help our busy staff of reporters and editors with their job to cover topics from a 360-degree perspective."
[2]
[3]
"Will this AI engine efficiently assist them in using publicly available facts to create the most helpful content so our audience can make better decisions? Will this enable them to create even more deeply researched stories, analyses, features, testing and advice work we're known for?," she asked.
[4]Writing tool from AI21 Labs won't do all the hard work for you
[5]AI-generated phishing emails just got much more convincing
[6]Cybercrooks are telling ChatGPT to create malicious code
[7]You get the internet you deserve
The answer appears to have been "No."
Stories attributed to CNET Money contain errors. An article on compound interest, for example, is wrong. "If you deposit $10,000 into a savings account that earns 3 [per cent] interest compounding annually, you'll earn $10,300 at the end of the first year," claims on story.
That's not quite right, you'll earn $300 with 3 per cent interest not $10,300. Mistakes in other articles show AI doesn't quite understand how mortgages and loans are paid off.
[8]
CNET will now review all of its AI-written copy to rewrite any false information generated by software. "We are actively reviewing all our AI-assisted pieces to make sure no further inaccuracies made it through the editing process, as humans make mistakes, too," a spokesperson [9]told Futurism. "We will continue to issue any necessary corrections according to CNET's correction policy." The Register has asked CNET for comment.
Large language models powering AI text generators, like the latest ChatGPT system, are fundamentally flawed; they may produce readable and grammatically correct sentences, but can't judge if their data is accurate or assess the veracity of their output. CNET's experiment with this technology hasn't revealed anything new: Current AI systems are flawed, but humans will use them anyway. Trust them at your own peril. ®
Get our [10]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Y8ki1ffMfAlIQFE32a1-nQAAABY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y8ki1ffMfAlIQFE32a1-nQAAABY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y8ki1ffMfAlIQFE32a1-nQAAABY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://www.theregister.com/2023/01/17/spices_ai_writing_tool/
[5] https://www.theregister.com/2023/01/11/gpt3_phishing_emails/
[6] https://www.theregister.com/2023/01/06/chatgpt_cybercriminals_malicious_code/
[7] https://www.theregister.com/2022/12/06/internet_ai_gpt_ios/
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y8ki1ffMfAlIQFE32a1-nQAAABY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[9] https://futurism.com/cnet-ai-errors
[10] https://whitepapers.theregister.com/
Re: The Reg - please don't...
> IMHO, it would dilute the wit of The Register's articles and reduce their originality.
Sadly that ship has already sailed...
Re: The Reg - please don't...
I agree with your 'second thought'. It would be quite entertaining and instructive if ElReg were to publish a regular AI-generated article, perhaps on a topic suggested by the readers.
I'm sure the commentards would love the opportunitiy to provide constructive criticism of the AI's work.
Hey AI, why are you putting on running shoes - you can't outrun a leopard?
I only have to outrun human business journalists.
Caught me off guard
I didn't know that CNET still had humans.
AI says
Try me, meat bag!
“$300 with 3 per cent interest not $10,300.“
To be honest I had to read back at that a couple of times before I spotted the error, leading me to think that maybe a majority of people would have overlooked it too and ChatGPT just followed the crowd. Either that or I’m dumber than AI!
I think that's the point. If I read the economics section of a major magazine, and the author appears to grasp the subject matter no better than myself, then what's the point of me reading it? Especially if, as LLMs do, the author states their mistaken claims in a confident, assertive, professional tone. That's spreading ignorance and mistakes, which is the opposite of what a (good) newspaper should do.
@Phones Sheridan
It's one of those grey areas.
The wording is incorrect, but your average human understands what the "AI" was meaning to say (that after a year your total is 10.3k & so infer .3k made in a year)
Seen similar sloppy errors in human journalism many times (I have made such errors myself when writing under time pressure - though I'm not a journalist so those cockups never went beyond the workplace!) - so as people have mentioned, could well be a bit of GIGO with training sets producing that type of output.
AI?
I wish everyone would stop using this term and use ML instead, which is far more accurate. AI suggests sentience. We're not there yet.
Re: AI?
I rather like the idea of calling it MI ... as in machine intuition, which I think suggests the hit/miss possibilities of the results reasonably well.
Re: AI?
Currently, I favor LLM (for Large Language Model). It drives home the notion that all these tools to is string together correct sentences.
Will this AI engine efficiently assist...
Us to pay fewer fleshy meatsacks?
Re: Will this AI engine efficiently assist...
That's so cynical! How can you even think a professional and respectable organization like CNN would consider such thing?
/sarcasm
Errata
> written with the help of AI, after it was found some contained incorrect information.
How absolutely awful. Writing articles containing incorrect information should be the sole domain of human writers. Though I doubt if a machine would ever write anything as meaningless as " to cover topics from a 360-degree perspective."
Although it's not unreasonable to expect that the job function of a publication's editor is to check basic information, spelling and grammar.
Re: Errata
Writing articles containing incorrect information should be the sole domain of human writers. ..... Pete 2
A domain in which some excel with the following a hat tip to at least two wannabe star turns.
Mark Carney has praised the British economy amid cautious signs of optimism over the global outlook.
Speaking at the World Economic Forum in Davos, the former governor of the Bank of England heaped praise on Britain’s institutional strengths that had allowed the economy to withstand a series of shocks after the financial crisis.
Falling energy cost in recent weeks have led to a better outlook for the global economy. The inflation rate in the UK appears to have peaked, too. .... Mehreen Khan, Davos January 18 2023, The Times
Is incorrect information akin to bullshit?
Re: Errata
I don't think that's incorrect information, it, like the Chancellor and his coffee cups, just omits to mention the Truss factor that dragged us into the financial crisis... it was mostly of our own making!
BS? yes, 100%
Long Live ...
ElReg!
No reply from CNET you say?
Allow me:
Compose a statement from CNET apologising for the using AI to write articles and explain why that decision was made
"We at CNET deeply apologize for our previous decision to use AI to write articles. We understand that this decision may have caused concern among our readers and the journalism community. We made this decision in an effort to increase efficiency and output, but we now realize that the use of AI in journalism raises important ethical questions and undermines the value of human-written content. In the future, we will ensure that all of our articles are written by our dedicated team of human journalists, who are committed to providing accurate and unbiased reporting."
Re: No reply from CNET you say?
Compose a comment in the style of amanfrommars from theregister.co.uk
"Well, well, well, what have we here? CNET, one of the stalwarts of tech journalism, apologizing for their use of AI in writing articles? Tsk tsk tsk.
It seems that the old adage 'if it ain't broke, don't fix it' has once again proven to be true. The use of AI in journalism, while touted as a way to increase efficiency and output, has done nothing but detract from the value of human-written content and raise important ethical questions.
But kudos to CNET for recognizing their mistake and committing to using only human journalists in the future. It's a shame that it took such a public apology for them to see the error of their ways, but better late than never, I suppose.
One can only hope that other outlets will take note and follow suit, for the sake of the integrity of journalism and the trust of the reading public."
I think we can say that although journalism might be dead, the comments section is safe for some time.
Re: No reply from CNET you say?
a comment in the style of amanfrommars
Fail. This was far too coherent.
AI
"Based on current events that I have listed below, write an article that will convince ordinary people to make financial decisions that will benefit the rich, while making themselves feel good about it"
That's how it goes.
Remember, never trust anything published in any financial rag. They are designed to make the rich richer and convince you to part with your money thinking you are going to make a good investment and then telling you, you should have left it to professionals, that it's your fault that you lost money.
Artificial Idiocy
"articles show AI doesn't quite understand"
Remember, so-called AI is just statistics helped by recently cheap and fast CPU cycles and storage, it doesn't "understand".
The Reg - please don't...
The Register: please try not to follow in CNET's footsteps, tempting as it may be for the sake of "efficiency".
IMHO, it would dilute the wit of The Register's articles and reduce their originality.
On second thought, go for it! It would offer us commenters a treasure trove of entertaining opportunity to descend on articles like a pack of wolves (apologies to wolves) and shred the AI-generated crap to pieces.