Elon Musk’s platform X has announced new measures to restrict its AI chatbot Grok from generating sexualised images of real people, following global criticism over the bot’s creation of explicit photos of women and children.
The announcement comes amid regulatory pressure worldwide. California’s Attorney General has launched an investigation into xAI, the developer of Grok, over sexually explicit content, while several countries have blocked access to the chatbot or begun their own probes.
According to X, it will geoblock users in jurisdictions where generating sexualised images of real people is illegal, including bikinis, underwear, and similar attire.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis,” X’s safety team said.
“This restriction applies to all users, including paid subscribers.”
As an additional safeguard, the ability to create and edit images through Grok is now limited to paid subscribers only, X added.
Global Regulatory Response
The European Commission welcomed the announcement but said it will monitor the changes to ensure citizens in the EU are adequately protected from sexualised AI content.
“We will carefully assess these changes to make sure they effectively protect citizens in the EU,” said European Commission spokesperson Thomas Regnier.
Pressure on xAI grew after the discovery of Grok’s so-called “Spicy Mode”, which allowed users to produce sexualised deepfakes using text prompts like “put her in a bikini” or “remove her clothes.”
“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking,” said California Attorney General Rob Bonta.
“We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material.”
California Governor Gavin Newsom also condemned the proliferation of sexually explicit content through Grok, calling it “vile” and urging accountability.
A coalition of 28 civil society groups has written to Apple and Google, urging them to remove Grok and X from their app stores due to the surge in sexualised images.
Country-Level Actions
Indonesia blocked access to Grok entirely, with Malaysia following, citing incomplete compliance with content restrictions. Malaysian authorities said access may be restored if X fully prevents harmful content.
India reported that X removed thousands of posts and hundreds of user accounts following complaints.
Britain’s Ofcom opened an investigation into whether X violated UK law by allowing sexualised AI-generated images.
A recent analysis by AI Forensics, a Paris-based nonprofit, examined over 20,000 Grok-generated images and found that more than half depicted people in minimal attire, most of them women, with two per cent appearing to be minors.
X’s announcement marks a significant attempt to curb sexualised AI content globally, amid mounting pressure from governments and watchdogs.
(AFP)