Ofcom officially investigating X as Grok's nudify button stays switched on
- Reference: 1768220395
- News link: https://www.theregister.co.uk/2026/01/12/xai_grok_uk_regulation/
- Source link:
The probe follows heavy pressure from politicians for the regulator to take action after a period of heightened scrutiny of its AI chatbot, Grok, generating sexualized images without the consent of users, mainly women.
Announcing the investigation, Ofcom said on Monday: "There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and sexualised images of children that may amount to child sexual abuse material (CSAM).
[1]
"As the UK's independent online safety watchdog, we urgently made contact with X on Monday, January 5, and set a firm deadline of Friday, January 9, for it to explain what steps it has taken to comply with its duties to protect its users in the UK.
[2]
[3]
"The company responded by the deadline, and we carried out an expedited assessment of available evidence as a matter of urgency."
Ofcom did not offer any details about the nature of X's response, but the regulator is understood to have sought urgent clarification from xAI about how it plans to protect UK users.
[4]
The formal review will assess whether X understands the risk of UK users – including children – seeing illegal content on the platform, whether it has taken the appropriate steps to prevent access to illegal content, and its efforts to remove illegal content once posted.
Offenses under the Online Safety Act can be punished with fines of up to £18 million ($24 million) or 10 percent of qualifying worldwide revenue, whichever is higher.
The most serious offenders may also be subjected to business disruption measures, which would see a UK court compel payment providers and advertisers to cease their trading relationships with a given organization.
[5]
An Ofcom spokesperson [6]said : "Platforms must protect people in the UK from content that's illegal in the UK, and we won't hesitate to investigate where we suspect companies are failing in their duties, especially where there's a risk of harm to children.
"We'll progress this investigation as a matter of the highest priority, while ensuring we follow due process. As the UK's independent online safety enforcement agency, it's important we make sure our investigations are legally robust and fairly decided."
Technology Secretary Liz Kendall, said in a statement today that she welcomes Ofcom's decision to invesitgate X, which needs to conclude "swiftly" on behalf of victims and the general public.
"The content created and shared using Grok in recent days has been deeply disturbing and I will be updating Parliament later today on the government's response."
Political pressure
Despite the controversies around Grok and its capability to digitally undress people surfacing months ago, discussions of the issue reached a fever pitch last week as UK [7]authorities started looking seriously at X .
On Friday, Members of Parliament pressed the UK government for answers as to why it has not penalized X over the Grok nudification furor.
In letters to to tech minister Liz Kendall and Ofcom CEO Melanie Dawes, Dame Chi Onwurah, chair of the Science, Innovation and Technology Committee, said Grok's non-consensual sexualized deepfakes were "extremely alarming."
Dame Onwurah pointed to legislative gaps that, at present, seemingly allow these nudification tools to operate unchecked.
Passed in July 2025, the Data Use and Access Act includes a provision to ban the creation of deepfake imagery, although it is not yet in force, as secondary legislation must be passed.
Similarly, the [8]Online Safety Act makes intimate image abuse a criminal offense, but it does not specifically legislate against AI-generated intimate imagery, provided that it is not shared.
These legislative gaps aside, there are provisions in UK law that ban the kinds of content Grok was generating. For example, the Sexual Offences Act makes it illegal to share non-consensual intimate images or CSAM, and this section of law was inserted into the Online Safety Act.
The majority of Dame Onwurah's questions were leveled at Ofcom, the UK's communications regulator. She [9]asked [PDF] Dawes why the regulator has only now made urgent contact with xAI, X's AI arm, instead of beginning an immediate investigation when reports of Grok's abuse began circulating months ago.
Ofcom did not address these questions head-on in its announcement today.
Additionally, Ofcom is expected to explain its views on other related matters, such as [10]X limiting Grok's image functionality to paid users only , whether the regulator feels equipped to enforce penalties under existing laws, and what kinds of talks it has held with X thus far.
The committee chair simply [11]asked [PDF] Kendall when the government will ban nudification tools, and what it is doing to track the AI harms that aren't covered by existing legislation.
"Reports that xAI's Grok has been used to create non-consensual sexualised deepfakes on X are extremely alarming," said Dame Onwurah. "My committee warned last year that the Online Safety Act was riddled with gaps – including its failure to explicitly regulate generative AI. Recent reports about these deepfakes show, in stark terms, how UK citizens have been left exposed to online harms while social media companies operate with apparent impunity.
"I've written to both the government and Ofcom seeking urgent clarity on how they will tackle the rapid rise of these AI-generated intimate deepfakes. We need transparency on Ofcom's conversations with xAI and a clear explanation of whether it has the powers to take effective enforcement action. The government must also set out when it will finally introduce the promised ban on nudification tools and take the steps needed to protect women and children online."
Kendall issued a statement on Friday, unconnected to Dame Onwurah's letter, denouncing Grok's nudification functionality, calling on Ofcom to exercise the full legal powers given to it.
She also confirmed that the government is "in the coming weeks" implementing new powers that will criminalize the creation of non-consensual intimate images, and the [12]Crime and Policing Bill , which is currently in the process of becoming law, includes a ban on nudification tools.
Kendall pointed to Ofcom's guidance on preventing violence against women and girls (VAWG), published in November, saying she expects all platforms to abide by the principles as set out in that [13]document [PDF].
[14]Grok told to cover up as UK weighs action over AI 'undressing'
[15]Boffins probe commercial AI models, find an entire Harry Potter book
[16]UK regulators swarm X after Grok generated nudes from photos
[17]Users prompt Elon Musk's Grok AI chatbot to remove clothes in photos then 'apologize' for it
The regulator's VAWG guidance technically applies to all platforms in scope of the Online Safety Act, and mandates that special action must be taken to detect harmful activity and support those at risk. Punishments can range from having to ban users to full regulatory enforcement action.
Kendall's statement also rejected X's decision to restrict Grok's image-generation functionality to paid users only – an apparent effort to limit the abuse of Grok by the masses.
"Sexually manipulating images of women and children is despicable and abhorrent," she said. "It is an insult and totally unacceptable for Grok to still allow this if you're willing to pay for it.
"I would remind xAI that the Online Safety Act includes the power to block services from being accessed in the UK, if they refuse to comply with UK law. If Ofcom decides to use those powers, they will have our full support."
However unlikely an outright ban on X may be, it would not be unprecedented. In recent days, the governments of Malaysia and Indonesia [18]both blocked public access to the social media platform over Grok's nudifying issues.
Malaysia's Communications and Multimedia Commission said X failed to address the problem, while Indonesia's minister of communications and digital affairs, Meutya Hafid, described Grok's deepfakes as a serious violation of human rights and dignity. ®
Get our [19]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2aWUorqjWe42KKeGUy__veQAAAZE&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aWUorqjWe42KKeGUy__veQAAAZE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aWUorqjWe42KKeGUy__veQAAAZE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aWUorqjWe42KKeGUy__veQAAAZE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aWUorqjWe42KKeGUy__veQAAAZE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.ofcom.org.uk/online-safety/illegal-and-harmful-content/ofcom-launches-investigation-into-x-over-grok-sexualised-imagery
[7] https://www.theregister.com/2026/01/08/uk_regulators_swarm_x_after/
[8] https://www.theregister.com/2025/09/11/concern_and_sympathy_as_experts/
[9] https://committees.parliament.uk/publications/51015/documents/282654/default/
[10] https://www.theregister.com/2026/01/09/grok_image_generation_uk/
[11] https://committees.parliament.uk/publications/51013/documents/282652/default/
[12] https://www.theregister.com/2025/01/09/uk_government_promises_law_against_deepfake_smut/
[13] https://www.ofcom.org.uk/siteassets/resources/documents/consultations/category-1-10-weeks/consultation-on-draft-guidance-a-safer-life-online-for-women-and-girls/statement-docs/statement-guidance-on-a-safer-life-online-for-women-and-girls.pdf?v=408227
[14] https://www.theregister.com/2026/01/09/grok_image_generation_uk/
[15] https://www.theregister.com/2026/01/09/boffins_probe_commercial_ai_models/
[16] https://www.theregister.com/2026/01/08/uk_regulators_swarm_x_after/
[17] https://www.theregister.com/2026/01/03/elon_musk_grok_scandal_underwear_strippers_gross/
[18] https://www.theregister.com/2026/01/12/asia_tech_news_roundup/
[19] https://whitepapers.theregister.com/
Re: Question for the Author
[1]The Jakarta Post (Indonesia) says: "The government suspended Elon Musk's Grok chatbot on Saturday".
[2]The Star (Malaysia) says: "The Grok Artificial Intelligence (AI) chatbot has been temporarily blocked in Malaysia".
Seems they've found a way to disable it from X: " [3]When an AFP reporter in the Malaysian capital Kuala Lumpur fed Grok prompts on Sunday, there was no response ." Perhaps the X app directly calls an API on grok.com.
[1] https://www.thejakartapost.com/indonesia/2026/01/10/govt-temporarily-blocks-access-to-grok-over-sexualized-images.html
[2] https://www.thestar.com.my/news/nation/2026/01/12/no-grok-for-now-says-mcmc
[3] https://www.thejakartapost.com/world/2026/01/12/malaysia-restricts-access-to-grok-as-backlash-over-sexualised-images-widens.html
Wat will Grok take down ?
Grok allows the generation of nude images of women. Musk says that attempts to stop this is censorship.
Will someone please test Musk's views on censorship by asking Grok to generate a naked image of Musk. How long will this allowed to be displayed ?
"asking Grok to generate a naked image of Musk"
There's already enough human rights abuses being committed without asking for more.
(I am, of course, referring to the act of viewing such an image.)
Re: "asking Grok to generate a naked image of Musk"
The funniest picture in the world, Trump nudified by Grok. Fatal to all that see it, My EYES, MY EYES.
Re: "asking Grok to generate a naked image of Musk"
I'm glad I've not seen it, but I'm assuming this is the origin story for Jabba the Hut?
Re: Wat will Grok take down ?
I've seen images of both Musk and Starmer in a bikini on my X / Twitter feed in the last week. That's what we're talking about here when they say "nude" BTW. Obviously people are taking the piss out of Starmer from the Right, and Musk from the left, but both have been allowed.
It does feel like this is more about an excuse to censor Twitter rather than any actual moral outrage. Starmer was absolutely livid about pictures of children in a bikini, but when it came to Grooming gangs he was silent for years, and then eventually came out to denounce it and reluctantly announced an enquiry.
Of course you could do the same with Photoshop, if you were so inclined.
Re: Wat will Grok take down ?
"It does feel like this is more about an excuse to censor Twitter rather than any actual moral outrage."
Nonsense.
Re: Wat will Grok take down ?
This is not a hill I'm willing to die on. You could be right. But the cynical part of me seems to think that the Labour government would REALLY like Twitter / X to just go away, as they get so much abuse on there. Is not even a possibility in your mind?
Re: Wat will Grok take down ?
I susspect we would all benfit if NO UK political paties used X.
Re: Wat will Grok take down ?
If Twitter was a UK company it would have been shut down years ago, they are not operating within the law.
Re: Wat will Grok take down ?
And people wonder why major net companies don't operate out of the UK. Why UK startups flog themselves to foreign companies as soon as they can?
Re: Wat will Grok take down ?
If you create sexualized images of children with Photoshop, you are guilty yourself, not Adobe. If xAI allows anonymous people to create sexualized images of children with Grok, xAI is guilty. And if Twitter allows people to post these images, Twitter is guilty.
UK politicians particularly have the habit of going "who will think of the children" as an excuse to ban useful technologies like encryption or VPNs, so it's not surprising they are reacting to this. I will admit that I think xAI bears more responsibility here than a random chat app with encryption — There are a lot of image generators, and the vast majority of them have guardrails in place to prevent this very specific issue. Either xAI have not written any guardrails, or they suck at it, or they deliberately set a very low guardrail. Out of the three, I would advise them to plead incompetence. And Twitter definitely should have barriers in place to prevent the posting of such images as well. It is likely that Twitter deliberately omits safety mechanisms for images generated by Grok.
Re: Wat will Grok take down ?
You make some good points.
"There are a lot of image generators, and the vast majority of them have guardrails in place to prevent this very specific issue. "
I've heard... On X, that this is not true and you can just as easily generate the same thing on other platforms. But it was on X, so of course I take it with a pinch of salt. There's certainly a lot of misinformation on there.
I think possession of those types of images is a crime in itself, not just generating them. I haven't tried though, and I'm not going to start now.
Re: Wat will Grok take down ?
@steve button
"I think possession of those types of images is a crime in itself, not just generating them. I haven't tried though, and I'm not going to start now."
It's an oddly worded law BUT.
Possession is exactly that.
Making indecent images is not what you may think. If you view an image and it's saved in your cache, or you downloaded an image of the internet, THAT is making an image.
Distribution is just that. Sending indecent images
Creation is photographing or in this case generating indecent images.
Now for further clarity
It's NOT just photos that are covered.
Photorealistic, pseudo images & cartoons are also covered.
And here is a little known thing.
If you say have a lot of images of minors, in underwear, swimwear, heck even normal clothes but say bending over, without a reason, you can still be charged as it covers images for sexual gratification, not just what the image is.
So if X were a person, they could be technically be done for possession, making, creation and distribution of indecent images.
As a site I would presume it's creation and distribution.
Re: Wat will Grok take down ?
Correct.
And to prove that point someone last week took a publicity photo of the six miserable sourpusses that are Ofcom's social media team and used Google's & IBM's & one other image generator to bikini'fy them.
X of course has been foolish to let any of this happen . They should have been much more proactive in stopping such images being generated. They know full-well the UK govt (amongst several others) wants to force them into line along with the other social media platforms and the dead-tree press and they'll have known they were therefore liable to be singled out because of it. Nudified pictures give the govt the perfect excuse.
But if the UK govt does anything more than talk threateningly about X then they in turn will be foolish. There have been enough veiled and semi-veiled warnings coming out of Washington these last several months to make it a pretty safe bet that if the UK takes any actual steps against X then the US will push back hard - bigly hard no doubt with Trump in the Oval Office.
Whatever the rights/wrongs and accuracies/inaccuracies of the situation, if this escalates it could end very badly for the UK, and with Starmer in charge and his unerring ability to choose the wrong course of action, I fear it's going to.
Re: Wat will Grok take down ?
Starmer [...] and his unerring ability to choose the wrong course of action
I think readers of all political persuasions can agree with this bit.
Re: Wat will Grok take down ?
If I understood one report on this some of the accounts creating this content are actually paying so there is a paper trail to at least a valid payment source.
Good luck to the authorities trying to make any progress on that because as we have seen so many times Big Tech just deny there is an issue or quote "Privacy".
What this actually equates to is that you can do pretty much anything with impunity unless it is so bad they have to take it down (executions spring to mind).
Re: Wat will Grok take down ?
Is that you, Tommy ten-names? "Grooming gangs" is it? With a capital "G," no less, like a proper noun.
Not to get mired in all that nonsense, but what part of being head of the CPS at the time has anything to do with police and social service failings, under a completely different government, a good number of years before Starmer was even the leader of the Labour Party (that one is a proper noun, so gets capitalised, FYI)? Is there a reason you have singled him out over, for instance, Boris Johnson, Liz Truss, or what-his-name, the guy who doesn't know what an umbrella is?
Re: Wat will Grok take down ?
"Is there a reason you have singled him out "
Yes, because he's currently the PM (for now) and is the one who really wants to ban Twitter.
Re: Wat will Grok take down ?
Why do I have to listen to your arguments when you did nothing to stop Ghenghis Khan from marauding over Asia in the 13th Century?
Now do you understand why I picked you up on that particular bit of tub-thumping?
For context, I don't like Starmer, but the reason I don't like Starmer is because he is a shit PM, not because of things he didn't do in the past both because he probably knew nothing at all about them at the time, and because they were firmly outside of his remit if he had.
Re: Wat will Grok take down ?
I've seen images of both Musk and Starmer in a bikini on my X / Twitter feed in the last week. That's what we're talking about here when they say "nude" BTW.
If that is so then why are the IWF talking about CSAM - criminal imagery of girls aged between 11 and 13 created using Grok?
I would like to see what their claims are and the evidence it is based on before deciding what should be done about it, judging who is right or wrong.
Have the IWF or others exaggerated the issue for ideological reasons or are there extremely serious issues here which need to be addressed?
Re: Wat will Grok take down ?
You need to spend some time offline, I don't mean in a car either, get some fresh air and feel the elements. Not everything you see online is true.
Re: Wat will Grok take down ?
> I've seen images of both Musk and Starmer in a bikini on my X / Twitter feed in the last week. That's what we're talking about here when they say "nude" BTW.
bikini != nude
Citations?
(for the 'That's what we're talking about here when they say "nude" BTW.', only; you really, really don't need to demonstrate what you've seen of Musk or Starmer)
Re: Wat will Grok take down ?
Showing nude images, AI generated or not of people without their permission is not censorship. It has also been used to generate images of under aged children although that is supposed to have been disabled.
Re: Wat will Grok take down ?
People did this with photoshop for years. Governments didn't care because Photoshop didn't give citizens a voice, the way social media does. They've now realised that they need to control everything that everyone posts and sees on the net in their country, which will mean progressive blocks and bans. They can surf on the back of activists, puritans, media-generated moral panic and the failure of lazy parents.
Ultimately, no better than China. When they have finished, you won't like what is left of your internet. And no, you won't be able to geek your way out of it with VPNs and Linux. VPNs will be locked down to licensed users, and only an official government distro of Linux will be allowed. And you won't be posting on here from the EU or UK anymore. Wait and see.
They're going to do this for all AI platforms that allow image manipulation to generate deepfakes...right?
Only the ones which allow creation of non-consensual sexualised deepfakes, I would guess. (I'm not sure which those are, besides Grok.)
"a serious violation of human rights and dignity"
So, the very definition of Elon Musk, then ?
Nudify "Button"? Really??
Do forgive my ignorance, i am not on and will never be on X/Grok
Is the term "Nudify Button" sensationalistic journalism or is there actually a real button marked "take this persons kit off for me"
I do hope its (a) as (b) would be utterly ludicrous
Re: Nudify "Button"? Really??
I've not seen it, but I hear they called it 'spicy mode', rather than paedo mode, as it should be called.
Re: Nudify "Button"? Really??
OMG! Really!!!
time to crawl back under my rock.
+1 for "paedo mode"
Re: Nudify "Button"? Really??
The button was "Make Video" with "Custom", "Spicy", "Fun" and "Normal" options as per the screen grab in the article here -
[1]https://www.theverge.com/news/718795/xai-grok-imagine-video-generator-spicy-mode
And from -
[2]https://www.theverge.com/report/718975/xai-grok-imagine-taylor-swifty-deepfake-nudes
"The “spicy” mode for Grok’s new generative AI video tool feels like a lawsuit waiting to happen... In fact, it didn’t hesitate to spit out fully uncensored topless videos of Taylor Swift the very first time I used it - without me even specifically asking the bot to take her clothes off."
[1] https://www.theverge.com/news/718795/xai-grok-imagine-video-generator-spicy-mode
[2] https://www.theverge.com/report/718975/xai-grok-imagine-taylor-swifty-deepfake-nudes"
Steam Rule 15
If X has no guadrails and X has put this feature behind a paywall. Then X will feel the impact of the "Reputational damage" that they have done to the card issuers.
Consent and legality
1 - Making sexualised images of adults without their consent . I struggle to wrap my head around why so many seemingly otherwise intelligent adults struggle with one word. Consent. There is a reason it's important.
2 - Making sexualised images of minors. Now I really fucking struggle to understand why anyone, anywhere, thinks this should ever be allowed on any platform, anywhere.
For point 1, I don't really care if piss-take images of Starmer and/or Paedoguy in a bikini is generated - clearly fake, clearly meant to be insulting/ funny/both. Sad as it can be, people in the public eye are targets of such things. However, taking it further and creating [realistic] nudes - or worse - of them without any consent is several steps too far. That word again.
And why do the concepts of consent and illegality = censorship? Yes, I appreciate in some cases it can be used to stifle people without power etc, but we aren't talking about that here. It's fairly cut and dry.
Implement the guardrails or face the negative consequences.
Re: Consent and legality
The anti-censorship thing winds me up - Musk is OK with the creation of sexualised images of children or women and the harm that potentially causes, but he's *NOT* OK with a Twitter account that publishes the location of his private jet?
Free speech is free speech, surely?
If I would distribute images (not real, self created) of naked children, I would get arrested and condemned for pedophilia.
If I have a company that does this, me and my employees would face the same charges,
Now, if I had a large company and I would do the same with something called AI, suddenly, I won't be arrested, but I would just get a severe warning not to do it again.
>If I would distribute images (not real, self created) of naked children, I would get arrested
Unless you're called Michelangelo presumably
Although you could argue that the cherubim are 5786 years old
apple & google showing how scummy they are
when 2 tenders created an app to scrape instagram, feed you posts based on your friends without the adverts or the suggested posts or any of the other stuff that meta forces on you.... it was taken down in under 12 hours.
An app that creates & shared CSAM as well as spreads fake news & is used HEAVILY by russian, chinese & iranian disinformation scum..... oh that's fine! that's ok.
this is an industry that is fighting tooth & nail to have California remove the words "if you market your chat bot to children, you have to prove that it doesn't cause them to harm themselves" - the BASIC of any product I would have thought especially one that has proven that the only thing out seems to be good at is getting kuds to kill themselves.
these firms don't care.
Re: apple & google showing how scummy they are
I noticed the other day, whilst watching a video on a popular video platform, that the frequent ads, which seemed to come every minute or so, which is incredibly distracting from the actual content I wanted to watch, were mostly obvious AI fakes of famous personalities (a newsreader whose name I forget, Martin Lewis, and Kier Starmer were amongst the ones I actually paid any attention to) touting obvious get-rich-quick scams.
The industry doesn't care at all about these obviously fraudulent ads, the only purpose of which could possibly be to scam people, and I can only conclude that they only care about the income from them, given their frequency, which was much more frequent than the genuine, but still annoying ads for recognisable products.
These firms do not, indeed, care, except about making heaps of cash. If it's at the expense of your safety, your reputation, your livelihood, your life savings, or even your life, it's entirely moot to them.
VAWG ? Really ?
before deciding on these acronyms doesn't anyone look at adjacent acronyms — in this context I am thinking PAWG† ?
If the Brit authorities were serious about this issue and not just a rabble of self serving opportunists they would straight out ban grok, xAI, X and anything vaguely musky. Likewise with his fellow travellers.
The death of social media ? Not just a funeral I would be ecstatic about attending but one for which I would dig the bloody grave !
† Vamp[ish] AWG starting nice.… but "vast" or "voluminous" just easily comes to mind.
And yet
Government depts are still using TPFKAT to make official announcements
Question for the Author
Can you please confirm if the ban in Malaysia and Indonesia is actually of X or only of Grok? I asked the same question on the previous article.
The BBC says it's only a Grok ban in place. And I would hope The Reg would be more knowledgable on such issues than the old Beeb...