News: 1631521805

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

Ghosts in the machine learning pipeline will be impossible to exorcise

(2021/09/13)


Opinion Tech rarely touches the soul. It enrages when [1]social media pours petrol on hotheads . It inspires when [2]Hubble comes back to life and delivers more cosmic awe. It pays our bills when we work in it, and it empties our pockets when we drunk-eBay that vintage console game collection. But when it brings back a dead lover?

That's no longer science fiction. A bored indie game dev in lockdown decided to use [3]OpenAI's GPT-3 to build a state-of-the-art chatbot based on data from a movie AI character. He opened it up to general access, and got minimal interest – until a chap called Joshua put decade-old conversations from his late fiancée, Jessica, so he could kinda, sorta talk to her again. That got into the papers because it's a touching and unsettling story, and up came the traffic.

It all ended uneventfully. Joshua moved on, while OpenAI, alerted to the project by the press, found it didn't match its ethical and safety criteria. The original developer decided they couldn't comply with those, so the project – and Jessica, which remained in suspended animation – was closed down.

[4]

Except, of course, it hasn't ended at all. There have long been questions about what happens to people's digital footprint after they die. Are they an asset to pass on? Should they be deleted when accounts close? But with social media and messaging systems now taking up so much of our conversations, what happens if someone harvests all the public stuff and runs it through natural language machine learning to reanimate someone? You can make a case that for close relatives, it should be their choice. So much is public, though, that complete strangers could build a virtual you. Every year, the software gets better, the compute gets a little cheaper, the barriers to doing this come down.

[5]

[6]

There is, of course, no law explicitly covering this. You can't copyright, trademark or patent a real-life personality. Impersonating the living is a valid career, free of licensing requirements. And the law seems reluctant to be inventive just because there's technology involved. Last week in the US, a [7]judge decided that AIs cannot patent their inventions , much like [8]monkey selfies can't be copyrighted , so whatever an AI output is, it's not going to be easy to legally control.

OpenAI knows this, which is why they and anyone else with half a sense of foreboding are so hot on developing AI ethics. That's not law, that's a code of conduct. The commercial potential of reanimating people is obvious; pick your favourite dead celebrity and hang out all evening online with them.

[9]

It gets weirder. A chatbot with a cryptocurrency wallet could carry on your political or cultural ambitions after you die, whether anyone else wants it to or not. Rich autocrats yearn for immortality to continue their dominance, but until now have had to settle for trying to set up a dynasty – a task that, thankfully, usually fails when the family falls apart. Now they have an option to keep meddling after their demise. Death limits dictatorial dystopias, but for how long?

Getting back to reality, there's no doubt that things like celebrity chatbots will be part of our world soon. If Abba can reform virtually and send creepy Abbatars out to holographically prance across the stages of the world, why not program a Bjornbot or two to engage the fans when they get back home. Such things will be uncontroversial, follow good ethics, and may even go beyond novelty over time. They will be filtered, monitored, and designed to be harmless – as far as they can.

OpenAI's ethical considerations, like those of many researchers and regulators, are based around avoiding harm. That may not be possible, even with the best designed intentions and foresight. When spiritualism was popular in the latter half of the 19th century, there was no shortage of sober investigators looking for scientific explanations, many of which excluded the supernatural – visions and voices came from within a person's mind. Others were good at debunking charlatans. But many didn't want to know – then as now, they chose to believe and be influenced by the interpretation they found most compelling. Then as now, this was a channel for fraud. But when someone just needs the comfort of contact, is that a harm? It is impossible to generalise. We'll have to suck it and see.

[10]

Famously, the very first chatbot, Eliza, surprised its creator, MIT researcher Joseph Weizenbaum, by its power to deceive. Programmed in the mid-1960s, it used list processing to find keywords in the user input and build simple replies, mimicking psychotherapy of the time. Users were enthralled and often convinced of its true intelligence, with Weizenbaum's secretary asking him to leave the room so she could have a private conversation. "I had not realized," he said, "that extremely short exposures to a relatively simple computer program could induce powerful delusional thinking in quite normal people."

[11]Docker's cash conundrum is becoming a bet on a very different future

[12]Adding AI to everything won't make sense until we can use it for anything

[13]Apple's iPhone computer vision has the potential to preserve privacy but also break it completely

[14]Please, no Moore: 'Law' that defined how chips have been made for decades has run itself into a cul-de-sac

[15]Truth and consequences for enterprise AI as EU know who goes legal: GDPR of everything from chatbots to machine learning

We are 50 years on from that. A single developer can build a system good enough to engage the emotions of a yearning young man by a simulacrum of his lost love. The potential to engineer in psychological dependence, or create a mix of disinformation and charismatic persuasion, at scale. These are not new concerns, what is new is the ubiquity of the systems that let us indulge them.

It will be hard to forget the image of Joshua, having rebuilt his fiancée, quietly saying goodbye again and closing the session down for the last time – leaving just enough credit on the system to bring her back but never doing so. Different to going through old photos, but no less human, no more harmful. A new kind of immortality is now within reach, and if the history of our culture is anything to go by, we will find the temptation irresistible. ®

Get our [16]Tech Resources



[1] https://www.theregister.com/2021/08/27/disinformation_is_an_industry/

[2] https://www.theregister.com/2021/07/20/hubble_first_pics/

[3] https://www.theregister.com/2021/09/08/project_december_openai_gpt_3/

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YT8hYhbSsbNXdASzidl0NAAAAFY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YT8hYhbSsbNXdASzidl0NAAAAFY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YT8hYhbSsbNXdASzidl0NAAAAFY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[7] https://www.bloomberg.com/news/articles/2021-09-03/only-humans-not-ai-machines-can-get-a-u-s-patent-judge-rules

[8] https://www.theregister.com/2017/09/12/monkey_selfie_case_settles_for_a_quarter_of_future_royalties/

[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YT8hYhbSsbNXdASzidl0NAAAAFY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YT8hYhbSsbNXdASzidl0NAAAAFY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[11] https://www.theregister.com/2021/09/06/docker_tier_shakeup_opinion_column/

[12] https://www.theregister.com/2021/08/30/golden_age_of_ai/

[13] https://www.theregister.com/2021/08/16/ai_vision_apple/

[14] https://www.theregister.com/2021/08/05/moores_law_what_next/

[15] https://www.theregister.com/2021/04/19/ai_regulation_column/

[16] https://whitepapers.theregister.com/



Hubert Cumberdale

It seems we've come a long way from [1]Dr. Sbaitso .

[1] https://en.wikipedia.org/wiki/Dr._Sbaitso

jake

Dr. Sbaitso.was pretty much the same thing as ELIZA, with a text to speech routine grafted on.

These modern toys are the same thing, just with faster processors and more memory.

For Whenever Taking a Walk on the WWWild Side of Life .......

amanfromMars 1

A new kind of immortality is now within reach, and if the history of our culture is anything to go by, we will find the temptation irresistible. .... Rupert Goodwins

Be fully prepared to accept that irresistible temptation has already comprehensively successfully captured the hearts and minds and provided all the necessary tools and vital virile ingredients for sublime and supremely engaging applications of the phenomenon ...... and against which there is no known possibility of real physical defence or practical virtual attack.

Successfully comprehensively captured the hearts and minds of whom and/or what is the gazillion dollar money shot question one always will find is safest best left securely unanswered ..... for some knowledge is deadly dangerous to know and share unwisely.

It's not imortality.

jake

It's a mere echo.

For further reading, may I suggest the Greek myth of the same name?

Food for thought.

nematoad

Rupert,

Thank you for a thoughtful and thought provoking piece on a subject that had slipped under my mental radar.

Uses of AI to recreate a person who we have lost is as you say an almost irresistible temptation and like many things, like fire, can be two-edged.

Both good and bad will come of this and I feel that not only the AI community should get a grip on the potential problems but the whole of society. One way would be through legislation but I have doubts if politicians are properly equipped to deal with it. Maybe some sort of commission or inquiry would help, that way we could gather the thoughts of everyone. All of us will be affected by this and it is only right that everyone is consulted and it is not left to vested interests to twist any controls on the technique to their private advantage.

Speaking for myself I would love to have been in a position to re-connect, however ephemerally, with people I have lost and I can see that handled in the right way and with sensitivity may well prove to be of great help to many people

Abbatar

Greybearded old scrote

Bjornbot? Agnetha's bot surely. (Rear of the Year 1975, for those not as grey as me.)

Re: Abbatar

jake

The original was boring, derivative, and repetitive enough ... who on earth would want to try to recreate it? Gluttons for punishment?

Re: Abbatar

Greybearded old scrote

I don't think you quite got which part of their act I was referring to.

It is only the great men who are truly obscene. If they had not dared
to be obscene, they could never have dared to be great.
-- Havelock Ellis