Japanese supermarket watches you shop so AI can suggest more stuff to buy
- Reference: 1691124432
- News link: https://www.theregister.co.uk/2023/08/04/generative_ai_japan_supermarket/
- Source link:
The Aruk Mitajiri supermarket, in the city of Hofu, started a trial of this arrangement yesterday, wielding tech from Fujitsu that uses video cameras to detect shoppers who linger at displays, compare multiple products, bend down towards a shop display, pick up a product, or respond to in-store content.
Observations of such behaviors are used to tune prompts for a generative AI manifested as a customized "Avatar concierge" that pumps out custom sales patter and/or content.
[1]
Fujitsu expects this process will result in customers returning to the shelves, confident of what they want to purchase and happy to splash the necessary wad of Yen.
[2]
[3]
The Japanese tech giant cooked this up in conjunction with a research group led by Naoto Onzo, director of the Institute of Marketing and Communication at Japan's Waseda University.
That team apparently advised Fujitsu that "warmth and competence, indicators of a customer service provider's personality and knowledge, as well as the design and functionality of the product, influence consumer buying decisions."
[4]
That insight led to the creation of a model that can "estimate the behavior transition probability of presenting customer service and promotional content based on the behavior and attribute data of individual customers analyzed by the human sensing technology."
Fujitsu reckons this is a good idea, because customers increasingly want "engaging, consumer-friendly experience" – but creating the content to deliver those takes time and money, and people to do the job.
AI can do it faster and cheaper.
[5]Fujitsu admits it fluffed the fix for Japan’s flaky ID card scheme
[6]Fujitsu sets out on 5-year mission to standardize ERP on SAP S/4HANA
[7]Fujitsu's A64FX successor will be an Arm-based datacenter chip
[8]Japanese convenience store chain opens outlet staffed by avatars and robots
What could possibly go wrong? Your correspondent often does the family shopping, which means I acquire bathroom products requested by the whole family. I have often stood transfixed in supermarket aisles, scanning for very specific terms on a bottle or box. I'm therefore fascinated to know what Fujitsu's tech will do when it spots a man shopping for products consumed only by women, or whether it can detect what remains of my hair and deduce that I'm probably not staring at the shampoo aisle and fondling the products there to meet my own needs.
The supermarket's trial of the tech runs until October 15. Fujitsu plans to launch a solution based on the trial during its 2023 financial year, which ends in on March 31, 2024. ®
Get our [9]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZMzMSBJCarbLiPg-ukuh-QAAAhA&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZMzMSBJCarbLiPg-ukuh-QAAAhA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZMzMSBJCarbLiPg-ukuh-QAAAhA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZMzMSBJCarbLiPg-ukuh-QAAAhA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2023/06/30/fujitsu_japan_micjet_id_card_pause/
[6] https://www.theregister.com/2023/04/11/fujitsu_one_erp/
[7] https://www.theregister.com/2023/03/06/fujitsus_a64fx_successor_will_be/
[8] https://www.theregister.com/2022/11/29/convenience_store_avatars_lawson/
[9] https://whitepapers.theregister.com/
Re: when it spots a man shopping for products consumed only by women
Hardly manipulation, unless one's a half-wit. How often have you forgot something on your shopping list then remember it when you get home? I have. An AI servant that reminds me of an accompanying or complementary product would be handy. Remember, you don't to follow the AI, unless you're a half-wit. Then you do need help...
Given that all supermarkets are doing it, there must be a sizeable amount of half-wits.
Re: when it spots a man shopping for products consumed only by women
Except it wont' work like that if the US/UK supermarkets start doing it. They're not in the habit of doing anything that helps customers unless they're making a killing off it. You'll be bombarded with what are essentially ads for promoted products. If you've ever done your supermarket shop online you'll have seen it already. Rows and rows of "suggested for you" that you have to scroll past to get to the thing you actually searched for. Shopping is a chore. The last thing I want is some annoying robot nagging me about why I really want to buy a fucking fruit cake.
Re: when it spots a man shopping for products consumed only by women
Would Sir like a chocolate bar? Oooh. Ooh. A nice, smooth, moist chocolate bar. Oooh. Slips down easy Sir, the wife will never know Sir. Ohh. Suits you Sir
Re: avatar whispering in my ear is going to send me online permanently
Some online shops have sequence like:
"I want to check out please" leads to the "special offers" page.
"I don't want any, I want to check out" leads to the "perhaps you forgot" page.
"Stop @$!|\|6 about and let me check out right now" leads to the "these items are really good" page
"Last chance or I walk away" lets you complete the order.
There is a bad chance that going elsewhere just puts you at the start of a similar sequence.
I have a barcode scanner. It would be really handy to scan empties into a file and xclip the list to a web site. If someone could figure out a way to do it with blockchain and an LLM perhaps it would happen.
"whether it can detect what remains of my hair"
It might well be able to do that. What it will deduce is that you should be encouraged to go to the pharmacy aisle to discover hair treatment products, hair regrowth products and assorted coloured dried frog pills.
No pseudo-AI we have now has ever deduced anything factually interesting about human behavior.
The day I stop seeing online ads for stuff I have just bought is the day I'll begin to grudgingly start accepting that "AI" might just be becoming useful, maybe.
Because if AI was actual AI, it would record the fact that I bought a UPS two years ago, and would start showing ads for replacement batteries in three years from now. Frightening as that may be, it would be useful.
But no, today's AI knows that I bought a LED flashlight, so it proposes batteries because duh, but it also proposes more flashlights.
Useless.
Within a few years we will need floating point to number the new Circles of Hell.
> customers increasingly want "engaging, consumer-friendly experience"
Remember who the customers are here. It's not you. It's the brands, including the supermarket itself.
You're the consumer part.
Honestly I'm running out of reasons to even use the supermarkets. Crap overpriced products, staff are underpaid and run so ragged they couldn't be friendly if they tried now being replaced with robots, psychological manipulation. Now this.
if there was a bot that could direct you to a specific product...
If there was a bot that could direct you to a specific product you're actually looking for in a Tesco gigastore, that would be extremely useful.
I realise conventional wisdom is that the more I have to hunt round to find what I'm looking for, I'm more likely to pick up other stuff I don't want, but in reality I'll probably give up and go to Lidl where there's only 4 aisles
AI can do it faster and cheaper.
Also I'm pretty sure it's still legal to punch a robot in the face, so in some senses this will be less annoying than having a human do it.
But still too annoying for me to want to go into a shop that has it.
Re: AI can do it faster and cheaper.
>” Also I'm pretty sure it's still legal to punch a robot in the face”
I value my knuckles, perhaps it will become advisable to visit such supermarkets after Cricket practice…
Next step?
Fancy shops are great and all, but they're still a shop - with expensive real estate costs, operating costs etc...
Surely the next big step is fully automated grocery shopping? Your house learns what you eat/drink, and orders a shop weekly with everything you are missing/need. With or without a human confirming the list is OK.
That'll be the next big marketing opportunity.
Re: Next step?
Given what kids like to eat, looks like that’s a lifetime’s supply of margarita pizza and lemonade…
New Horizon ?
I can see it now
We suggested you buy X.
You didn’t buy it therefore you must be intending to steal it.
Let’s prosecute the customer.
No that wouldn’t happen, I mean it is not like it happened in another shop like a post office.
More stuff I can't find
Every time I go shopping, my wife always ensures that there's at least one item on the list which I can't find eg extract of Himalayan yak's foot. I don't need some AI suggesting more things I can't find.
Now where did I see the idea of ad-slinging avatar?
Oh yes, the Zero Theorem https://www.youtube.com/watch?v=Cs8GxPO55tM
"engaging, consumer-friendly experience"
Well, then you have far too many self-service checkouts and not enough traditional ones.
I call bullshit. You don't want "engaging, consumer-friendly experience" at all, you want lower overheads.
And like self-service, your new upselling tech can just fuck off.
Gotta be cute
It doesn't say what form the avatar will take, but if it's a cute robot that bows and will guide me to the sushi discounted 50% before closing time, I'll take it.
when it spots a man shopping for products consumed only by women
Ah, it seems Sir is purchasing female sanitary products. Perhaps Sir would like directing to the beer aisle?
Ok, a very old joke... but to be honest, enough of this crap! We shop for products we need and I suspect no-one enjoys the psychological manipulation (ooh, I can smell fresh baking! Put essentials/staples at the back of the store so we have to tramp past everything else! Rearrange things on a regular basis so you have to search the whole store!). Having some avatar whispering in my ear is going to send me online permanently, not encourage me to remain in the store and buy more crap I don't need.
(Perhaps Sir would like... maybe Sir should consider... would Sir like... Why is Sir heading to the firearms section?)