News: 1675751473

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

China’s Baidu reveals generative AI chatbot based on language model bigger than GPT-3

(2023/02/07)


Chinese web giant Baidu, which has “AI” in its name and has made AI the focus of its hyperscale cloud, has revealed it will launch a generative AI chatbot later this year.

[1]Chinese media reported the launch and Baidu confirmed it to The Register .

“The company plans to complete internal testing in March before making the chatbot available to the public,” a Baidu spokesperson wrote.

[2]

The bot will be named “Wenxin Yiyan文心一言” or "ERNIE Bot" in English.

[3]

[4]

The spokesperson added that the bots are based on the Enhanced Representation through Knowledge Integration (Ernie) model first proposed in 2019. We were told Ernie “expands into a series of advanced big models that can perform a wide range of tasks, including language understanding, language generation (ERNIE 3.0 Titan), and text-to-image generation (ERNIE-ViLG).”

“What sets ERNIE apart from other language models is its ability to integrate extensive knowledge with massive data, resulting in exceptional understanding and generation capabilities,” the spokesperson added.

[5]

Just what the bot will be capable of is not known, but Baidu has over the years described its ambitions for something that sounds an awful lot like ChatGPT. As we [6]noted yesterday, Baidu has discussed "proposed a controllable learning algorithm and a credible learning algorithm to ensure the model can formulate reasonable and coherent texts". It’s done the hard work to deliver such a system, having in 2021 [7]detailed “ERNIE 3.0 Titan” – a pre-training language model with 260 billion parameters.

ChatGPT uses the 175-billion parameter GPT3 model.

[8]Twitch bans AI-generated Seinfeld show for making transphobic jokes

[9]It is possible to extract copies of images used to train generative AI models

[10]ChatGPT (sigh) the fastest-growing web app in history (sigh) claim analysts

[11]GPT-4 could pop up in Bing, as Google races to build chatbot search products

ERNIE/文心一言 is bilingual in English and Chinese. A pre-press [12]paper [PDF] from 2021 details the performance of ERNIE, and asserts that the model is superior to all rivals – including GPT-3 – at many tasks.

In the months since ChatGPT’s release it has generated fevered speculation that it and rival chatbots represents the future of internet search, the software industry, and any form of human endeavour that involves writing.

Google’s Monday announcement of its own generative chatbot named [13]Bard is widely held to be a somewhat panicked response to interest in ChatGPT, and perhaps to an invitation Microsoft issued for a Tuesday event expected to reveal its own AI tech.

[14]

Baidu’s announcement certainly turned heads: the company’s share price spiked around 15 percent in the hours after the company revealed ERNIE/文心一言. ®

Get our [15]Tech Resources



[1] https://www.cls.cn/detail/1258842

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Y@IvTevL9baAxKW@Rlzm7QAAABg&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@IvTevL9baAxKW@Rlzm7QAAABg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@IvTevL9baAxKW@Rlzm7QAAABg&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Y@IvTevL9baAxKW@Rlzm7QAAABg&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://www.theregister.com/2023/02/06/ai_roundup/

[7] http://research.baidu.com/Blog/index-view?id=165

[8] https://www.theregister.com/2023/02/07/twitch_ai_seinfeld/

[9] https://www.theregister.com/2023/02/06/uh_oh_attackers_can_extract/

[10] https://www.theregister.com/2023/02/03/chatgpt_most_popular_apps/

[11] https://www.theregister.com/2023/02/02/microsoft_gpt4_google_search/

[12] https://arxiv.org/pdf/2107.02137.pdf

[13] https://www.theregister.com/2023/02/06/google_bard_ai/

[14] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Y@IvTevL9baAxKW@Rlzm7QAAABg&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[15] https://whitepapers.theregister.com/



Reminder

PhilipN

In the UK ERNIE was for the National Lottery, kids.

Electronic Random Number Indicator Equipment or thereabouts.

Re: Reminder

David 132

Premium Bonds. Not National Lottery. But yeah, you beat me to it!

Re: Reminder

katrinab

Yes, Electronic Random Number Indicator Equipment, but it is for Premium Bonds, not the National Lottery. Premium bonds is a bit like a lottery except the prizes are generally much lower, and you get your "ticket" price back even if you don't win.

Re: Reminder

Roger Kynaston

Could it be revenge for the Opium wars? Brits will feed their Premium bond number into it and the Chinese gummint will then switch the ownership so they win £50 pounds every once in a while?

Anonymous Coward

How fast can it bring me my milk?

Arbuthnot the Magnificent

Pasteurised is best!

David 132

"Pasteurized? I'd be happy if it comes up to me chest!"

David 132

Faster than any other one in the West!

I wonder what it will say ...

alain williams

if you ask it to write a story about what happened in Tiananmen Square in 1989 ?

The [1]Simpsons are not allowed to mention it .

[1] https://www.theguardian.com/world/2021/nov/29/disney-channel-launches-in-hong-kong-without-the-simpsons-tiananmen-square-episode

I am a traffic light, and Alan Ginzberg kidnapped my laundry in 1927!