News: 1633496410

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

User to chatbot: Help! My kid has COVID! Chatbot to user: Always wear a condom

(2021/10/06)


A chatbot used by Singapore's Ministry of Health (MOH) has been switched off after providing inappropriate answers to residents' queries on COVID-related matters.

Screenshots of gaffes from the chatbot tool appeared online earlier this week.

Here's an example of the errors on offer: a suggestion that practicing safe sex is the way to help a child with COVID as described in a [1]Reddit post .

[2]

Click to enlarge

In addition to suggesting condom use when a child tests positive for COVID, [3]some reports revealed users were pointed to clinics to receive the polio vaccine instead of COVID testing.

Ask Jamie – referred to by its Natural Language Processing (NLP) software provider [4]flexAnswer as "the world's first Whole of Government Virtual Assistant" – was developed by Singapore's Government Technology Agency (GovTech). The chatbot was conceived in 2014 and is deployed across 70 government agency web sites.

[5]

In the past, GovTech has [6]actively encouraged Singaporeans to use Ask Jamie for COVID-related questions.

[7]A developer built an AI chatbot using GPT-3 that helped a man speak again to his late fiancée. OpenAI shut it down

[8]Korean app-maker Scatter Lab fined for using private data to create homophobic and lewd chatbot

[9]In a devastating blow to all eight of you, Microsoft pulls the plug on Cortana's Android, iOS apps

Now the bot's been banished from the MOH web site after the blunders were revealed. It remains available, and functioning properly, on several other government sites.

It appears that Ask Jamie's days were numbered even before this glitch, though, as a number of sites (including the main [10]gov.sg site) are already using a different assistant based around a [11]next-generation natural-language processing engine. GovTech says its plan is that the new bot, which is called "Ask Emma" at least on the Energy Market Authority web site, will eventually replace Jamie completely.

[12]

Poor Jamie.

Requests for comment from The Register to both MOH and GovTech have gone unanswered, but Singapore's MOH did tell the [13]Straits Times it was aware of the "misaligned replies" and the technology was temporarily disabled while a system check and improvements were underway.

[14]

Singapore residents with COVID-related questions have been asked to refer to [15]this web site instead. ®

Get our [16]Tech Resources



[1] https://www.reddit.com//r/singapore/comments/q0iiug/thanks_jamie_moh_but_thats_not_what_i_wanted_to/

[2] https://regmedia.co.uk/2021/10/06/screnshot_ask_jamie_chatbot_fail.jpg

[3] https://www.todayonline.com/singapore/moh-takes-down-ask-jamie-chatbot-that-gave-misaligned-covid-19-advice

[4] https://www.flexanswer.com/about-us/

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YV1z43cZGX5gLOPhQv3c9gAAAE4&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[6] https://www.facebook.com/18658822510/photos/a.411947277510/10156800868742511/?type=3

[7] https://www.theregister.com/2021/09/08/project_december_openai_gpt_3/

[8] https://www.theregister.com/2021/04/29/scatter_lab_fined_for_lewd_chatbot/

[9] https://www.theregister.com/2021/04/01/microsofts_cortana_smartphone/

[10] https://www.gov.sg

[11] https://www.tech.gov.sg/products-and-services/vica/

[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YV1z43cZGX5gLOPhQv3c9gAAAE4&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[13] https://www.straitstimes.com/tech/covid-19-confused-with-safe-sex-by-ask-jamie-chatbot-on-mohs-website

[14] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YV1z43cZGX5gLOPhQv3c9gAAAE4&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[15] https://www.covid.gov.sg/

[16] https://whitepapers.theregister.com/



Removed

Winkypop

Poor Jamie couldn’t talk and chew gum^ at the same time.

^ Generally illegal in Singapore

Condom

redpawn

I hope Emma uses one so she doesn't catch what Jamie has.

Allan George Dyer

"The chatbot was conceived in 2014"

If only the Ministry of Health had used a condom in 2014, this could have been prevented.

sanmigueelbeer

or abstinence, for at least the whole duration of her female partner's pregnancy.

Where did that chatbot answer come from?

Anonymous Coward

"Use a condom throughout the duration of your female partner's pregnancy?" Never mind that this isn't the answer to the question that was asked, to what question is that the right answer?

Re: Where did that chatbot answer come from?

katrinab

Testing positive for the Zikka virus apparently.

Boris to launch new health chatbot for England

Fruit and Nutcase

Ask Dido!

*Health being a devolved function means Wales, Scotland and NI miss-out on the one-size-fits all top-down thinking that people in England have to put up with

Anonymous Coward

Why would anybody think it's a good idea for a chatbot to give health advice? The people who approved that are dangerously incompetent.

Ii can't see the problem.

IGotOut

They look exactly like the correct answers you'd get on any forum or social media.

Re: Ii can't see the problem.

Pascal Monett

That's why I don't use "social" media.

Leave no stone unturned.
-- Euripides