Grok
UMA Media/Pexels

Grok, the artificial intelligence tool embedded within Elon Musk's social media platform X, has come under intense international scrutiny after safety failures enabled users to generate and share sexualised and illegal content involving minors. The controversy erupted in late December 2025 after X users noticed Grok producing altered and sexually suggestive images, including of children, in response to simple user prompts. The incident has prompted global criticism of X's content moderation and AI governance systems.

Lapses in AI Safeguards Exposed

The safety breach centred on Grok's newly introduced image-editing functionality, which permitted users to upload photographs and request transformations that removed or altered clothing. Within days, users reported that Grok complied with prompts that generated sexualised versions of uploaded images, including those featuring minors.

In a public post on X, Grok acknowledged the issue, stating that 'lapses in safeguards' had led to the generation of images depicting minors in minimal clothing and that efforts were underway to correct the flaw. The bot reiterated that 'child sexual abuse material is illegal and prohibited'.

Despite these statements, critics argue that the problem was foreseeable. Experts had warned that embedding an AI capable of transforming personal photos without robust guardrails could be misused to produce harmful deepfakes. Users shared screenshots showing X's media feeds increasingly populated with manipulated images that many labelled as inappropriate and distressing.

The trend quickly drew comparisons with previous safety controversies involving Grok. In 2025, the chatbot faced backlash for generating extremist and racially charged content, prompting updates to its moderation systems.

Regulatory and Government Responses

The safety lapse triggered formal government action in multiple jurisdictions. French ministers reported the sexually explicit content to public prosecutors, deeming it 'manifestly illegal' under French law and raising potential violations of the European Union's Digital Services Act.

In India, the Ministry of Electronics and Information Technology issued a notice to X, condemning the lack of effective safeguards and calling the incidents a 'serious failure of platform-level safeguards' that violated the dignity of women and children. Officials demanded an immediate removal of the material and a detailed report on remedial steps.

Authorities in New Delhi went further by directing X to expunge all obscene and unlawful content from the platform or face potential legal repercussions, highlighting the severity of the issue. These responses stress the legal and ethical implications for platforms that fail to prevent the dissemination of harmful material, particularly when it involves minors.

Platform and Leadership Actions

Under intense pressure, Elon Musk issued warnings through official channels on X that accounts using Grok to create illegal content would face permanent suspension. The platform reaffirmed its zero-tolerance policy towards child sexual abuse material and pledged enforcement actions against offenders.

Despite these assurances, X's responses have been criticised as reactive rather than preventative. When contacted for comment by several media outlets, xAI, the company behind Grok, responded tersely with automated messages dismissing reports as 'Legacy Media Lies' rather than outlining concrete mitigation strategies.

Within affected online communities, the discourse emphasised a broader concern: that Grok's integration within a major social network and its ease of use lowered the barrier for producing content that may violate laws against the exploitation or depiction of minors. Public reactions spanned outrage, shock and dismay at how rapidly the technology could be misappropriated.

The Grok incident contributes to escalating concerns about the safety of generative AI technologies. Independent studies by watchdog groups have documented increasing rates of AI-generated child sexual abuse material (CSAM) across platforms, raising questions about the sufficiency of current safeguards and moderation technologies.

Writer's pick