The company is taking steps to remove CSAM content and nudity, as well as to act against users who violate X’s rules. xAI said it will report to law enforcement those who attempt to access or generate such materials.
“We have implemented technical measures to prevent the editing of images of real people in revealing clothing, such as bikinis, via Grok accounts. This restriction applies to all users, including paid subscribers,” the notice said.
Image generation and editing through Grok accounts on X are now available only to premium users. xAI believes this will help hold accountable individuals who abuse the chatbot’s capabilities.
Developers described the restrictions as an addition to existing safety protocols and announced plans to introduce further protective measures
Another scandal
In early January, Grok became embroiled in another controversy after it was found capable of generating images of nude real people, including minors.
The UK-based Internet Watch Foundation said its analysts discovered “criminal material” involving children aged 11 to 13 that was allegedly created using Grok.
Musk said he was unaware of any cases in which the chatbot had been used to generate images of nude minors.
“Obviously, Grok doesn’t generate this spontaneously. It does so based on user prompts,” the entrepreneur emphasized.
According to him, the chatbot refuses to create illegal content, though there may be cases of “adversarial exploits” that lead to “unexpected outcomes.”
On January 11, Malaysia’s regulator ordered temporary restrictions after what it described as “repeated failures by X Corp” to address risks associated with the AI service.
A day earlier, Indonesia suspended access to the chatbot over similar concerns and summoned company representatives for discussions.
Regulators in the EU, the UK, Brazil, and India have also called for investigations into Grok’s role in the spread of deepfakes.
A coalition of 28 organizations focused on digital rights, women’s rights, and child protection has urged the heads of Apple and Google to take action and remove X and the Grok chatbot from their app stores.
The Grok case underscores how rapidly generative AI can move from innovation to liability when safety controls lag behind deployment.
