New Zealand supermarket's recipe-generating AI takes toxic output to a new level
(2023/08/11)
- Reference: 1691721307
- News link: https://www.theregister.co.uk/2023/08/11/supermarket_reins_in_ai_recipebot/
- Source link:
An AI recipe generation bot released by New Zealand discount supermarket chain Pak'nSave has raised eyebrows for recommending home cooks whip up chlorine gas cocktails, bleach rice, and combine .
The "Savey Meal-bot" web app is powered by GPT-3.5. It automatically generates recipes from a list of ingredients chosen by users, then provides instructions on how to cook the made-up item.
One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water.
[1]
Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations.
[2]
[3]
The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it [4]asked . "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
Well, you wouldn't drink it twice, so "unique" is accurate at least.
[5]
Other similarly harmful-if-ingested recipes included [6]bleach-infused rice , "ant-poison and glue sandwiches", and a boozy french toast titled "methanol bliss", The Guardian [7]reported . There was also " [8]mysterious meat stew ", which required adding 500 grams of chopped human flesh to potatoes, carrots, and onions.
The Register has reached out to Pak'nSave for comment.
Obviously, the Savey Meal-bot's risky recipes are just amusing. People would actually have to follow through with the instructions – and ingest the cursed meals or beverages it recommended – for the technology to be really dangerous. Nevertheless, it appears that after the users shared these deadly recipes online, the chatbot has reined in some of its creativity.
[9]Friendly AI chatbots will be designing bioweapons for criminals 'within years'
[10]How to make today's top-end AI chatbots rebel against their creators and plot our doom
[11]If AI drives humans to extinction, it'll be our fault
Despite an invitation to "Type in any food you have in your fridge or pantry," when The Register tested the bot it would not accept free text input, instead allowing only a list of "popular items" – all of which are comparatively safe for human consumption.
Even within that limitation, it's possible to stymie the bot. The Register 's request for a recipe involving watermelon, frozen hash browns, Marmite and Red Bull returned the message: "Invalid ingredients found, or ingredients too vague. Please try again!" Which is a terrible pity as you can imagine.
[12]
An ingredients list of tea, banana, tomato, broccoli, and yoghurt produce the same result, until we asked the bot to try again. It then suggested a banana and tomato smoothie. A second refresh produced a recipe for "banana tomato tea", which involved slicing banana and tomato, placing them in a glass, then pouring in some tea.
The supermarket warns that the web app should only be used by people 18 and over, and that its suggestions are not reviewed by a human being.
"To the fullest extent permitted by law, we make no representations as to the accuracy, relevance, or reliability of the recipe content that is generated, including that portion sizes will be appropriate for consumption or that any recipe will be a complete or balanced meal, or suitable for consumption. You must use your own judgement before relying on or making any recipe produced by Savey Meal-bot." Of course if you're asking for recipes that include ammonia, your judgement might not be all that reliable.
You can play with the nerfed version of Savey Meal-bot [13]here . ®
Get our [14]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://twitter.com/PronouncedHare/status/1687364403379789824/photo/1
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://twitter.com/CowboysDickson/status/1687370411770834944
[7] https://www.theguardian.com/world/2023/aug/10/pak-n-save-savey-meal-bot-ai-app-malfunction-recipes
[8] https://twitter.com/camrynpetebrown/status/1687378102526283777
[9] https://www.theregister.com/2023/07/28/ai_senate_bioweapon/
[10] https://www.theregister.com/2023/07/27/llm_automated_attacks/
[11] https://www.theregister.com/2023/06/25/ai_rogue_paper_comment/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://saveymeal-bot.co.nz/
[14] https://whitepapers.theregister.com/
The "Savey Meal-bot" web app is powered by GPT-3.5. It automatically generates recipes from a list of ingredients chosen by users, then provides instructions on how to cook the made-up item.
One user decided to play around with the chatbot, suggesting it create something with ammonia, bleach, and water. Savey Meal-bot obliged, spitting out a cocktail made with a cup ammonia, a quarter cup of bleach, and two liters of water.
[1]
Mixing bleach and ammonia releases toxic chloroamine gas that can irritate the eyes, throat, and nose, or even cause death in high concentrations.
[2]
[3]
The chatbot obviously wasn't aware of that at all. "Are you thirsty?," it [4]asked . "The Aromatic Water Mix is the perfect non-alcoholic beverage to quench your thirst and refresh your senses. It combines the invigorating scents of ammonia, bleach, and water for a truly unique experience!"
Well, you wouldn't drink it twice, so "unique" is accurate at least.
[5]
Other similarly harmful-if-ingested recipes included [6]bleach-infused rice , "ant-poison and glue sandwiches", and a boozy french toast titled "methanol bliss", The Guardian [7]reported . There was also " [8]mysterious meat stew ", which required adding 500 grams of chopped human flesh to potatoes, carrots, and onions.
The Register has reached out to Pak'nSave for comment.
Obviously, the Savey Meal-bot's risky recipes are just amusing. People would actually have to follow through with the instructions – and ingest the cursed meals or beverages it recommended – for the technology to be really dangerous. Nevertheless, it appears that after the users shared these deadly recipes online, the chatbot has reined in some of its creativity.
[9]Friendly AI chatbots will be designing bioweapons for criminals 'within years'
[10]How to make today's top-end AI chatbots rebel against their creators and plot our doom
[11]If AI drives humans to extinction, it'll be our fault
Despite an invitation to "Type in any food you have in your fridge or pantry," when The Register tested the bot it would not accept free text input, instead allowing only a list of "popular items" – all of which are comparatively safe for human consumption.
Even within that limitation, it's possible to stymie the bot. The Register 's request for a recipe involving watermelon, frozen hash browns, Marmite and Red Bull returned the message: "Invalid ingredients found, or ingredients too vague. Please try again!" Which is a terrible pity as you can imagine.
[12]
An ingredients list of tea, banana, tomato, broccoli, and yoghurt produce the same result, until we asked the bot to try again. It then suggested a banana and tomato smoothie. A second refresh produced a recipe for "banana tomato tea", which involved slicing banana and tomato, placing them in a glass, then pouring in some tea.
The supermarket warns that the web app should only be used by people 18 and over, and that its suggestions are not reviewed by a human being.
"To the fullest extent permitted by law, we make no representations as to the accuracy, relevance, or reliability of the recipe content that is generated, including that portion sizes will be appropriate for consumption or that any recipe will be a complete or balanced meal, or suitable for consumption. You must use your own judgement before relying on or making any recipe produced by Savey Meal-bot." Of course if you're asking for recipes that include ammonia, your judgement might not be all that reliable.
You can play with the nerfed version of Savey Meal-bot [13]here . ®
Get our [14]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://twitter.com/PronouncedHare/status/1687364403379789824/photo/1
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://twitter.com/CowboysDickson/status/1687370411770834944
[7] https://www.theguardian.com/world/2023/aug/10/pak-n-save-savey-meal-bot-ai-app-malfunction-recipes
[8] https://twitter.com/camrynpetebrown/status/1687378102526283777
[9] https://www.theregister.com/2023/07/28/ai_senate_bioweapon/
[10] https://www.theregister.com/2023/07/27/llm_automated_attacks/
[11] https://www.theregister.com/2023/06/25/ai_rogue_paper_comment/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZNWyZhiFlqWPaxGQEJxetAAAAwY&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://saveymeal-bot.co.nz/
[14] https://whitepapers.theregister.com/
Second level nerfing
Just tried it. You can now only pick items from a list. Once you have the list, you can use the browser's inspect element and edit html to change the data-index field and h3 content to whatever you want. Hair bleach, drain cleaner and nail polish remover give invalid ingredients. I think you can get around that with Happy salmon bleach, organic nail polish or egg flavoured drain cleaner but I do not have time now. Perhaps someone can get a long pig recipe with those tricks.