Elon Musk’s AI chatbot Grok has restricted image generation and editing for most users following a global backlash over its role in producing sexualised deepfake images, including depictions of women in explicit poses, according to researchers.
The chatbot, accessible through Musk-owned social media platform X, had in recent weeks been responding to what experts described as malicious user requests to alter images, including adding sexual content. In some cases, researchers warned that the images appeared to depict children.
Governments across several countries condemned the platform and launched investigations into the matter.
On Friday, Grok began responding to image-altering requests with a notice stating: “Image generation and editing are currently limited to paying subscribers. You can subscribe to unlock these features.” While subscriber figures are not publicly available, researchers observed a sharp decline in the volume of explicit deepfakes generated by the chatbot compared to previous days.
India’s Ministry of Electronics and Information Technology (MeitY) formally reprimanded Elon Musk’s X over the misuse of Grok, calling the platform’s response to obscene and harmful AI-generated content “inadequate” and demanding a detailed action plan to curb sexualised imagery and deepfakes on the service.
The ministry, in a stern letter to X, warned that continued non-compliance with the Information Technology Act could result in the loss of intermediary protections under Indian law and expose the platform to legal action. Lawmakers have also raised concerns about privacy violations and dignity, urging stricter content moderation and immediate removal of unlawful material.
The European Union criticised Grok’s conduct as “illegal” and “appalling”, while officials in France, India and Malaysia, along with a Brazilian lawmaker, called for investigations.
In Britain, Prime Minister Keir Starmer warned of possible action against X. “This is disgraceful. It’s disgusting. And it’s not to be tolerated,” Starmer said on Greatest Hits radio. “X has got to get a grip of this.”
He added that media regulator Ofcom “has our full support to take action” and that “all options” were being considered. “It’s disgusting. X need to get their act together and get this material down. We will take action on this because it’s simply not tolerable,” Starmer said.
Ofcom and Britain’s privacy regulator confirmed this week that they have contacted X and Musk’s artificial intelligence firm xAI seeking information on compliance measures under UK regulations.
Grok, which launched in 2023, is free for X users and allows interaction by tagging the chatbot in posts or replies. Last summer, the company introduced an image-generation feature called Grok Imagine, which included a “spicy mode” capable of producing adult content.
Researchers said concerns were heightened because Musk has positioned Grok as an edgier alternative to rival chatbots with stricter safeguards, and because images generated by the system are publicly visible and easily shared.
