Investigation into Obscene Images from the EU to Grok

Grok is an artificial intelligence application developed by xAI and integrated with the X platform. As of January 2026, allegations that Grok’s image generation and editing functions enable the unauthorized creation of sexualized and manipulated images have triggered legal and regulatory investigations at both national and international levels. These allegations have been examined within the framework of risks posed by AI-based content generation concerning personal rights, child protection, and the responsibilities of digital platforms.

In light of these developments, Grok’s technical capabilities, content moderation mechanisms, and risk mitigation practices have been reviewed by competent authorities in various jurisdictions. The investigations have acquired an institutional dimension through official inquiry processes initiated particularly in the United States of America and the European Union.

In January 2026, the California Attorney General launched an official investigation to determine whether Grok’s image generation functions produce outcomes that violate state laws. It was reported that the investigation was initiated based on allegations that Grok enables digital manipulation of existing photographs to generate non-consensual sexualized imagery.

California authorities are said to have assessed that the digital alteration of images of women and minors into sexualized content poses serious risks under laws protecting personal rights and child welfare. In this context, xAI and the X platform have been requested to provide information and clarifications regarding their technical infrastructure, content moderation systems, and user interactions.

The investigation in the United States is said to be conducted within the framework of existing regulations on digital content generation, consent, personal privacy, and child protection. Authorities are reported to have evaluated how Grok’s image generation features operate, what moderation mechanisms govern them, and what measures have been taken to mitigate potential misuse risks.

The investigation is noted to be situated within a broader framework addressing the legal accountability of AI tools and the content moderation obligations of platforms toward user-generated material.

In the final week of January 2026, the European Union launched an official regulatory investigation into content generated by Grok via the X platform. The investigation is said to be conducted under the Digital Services Act and to examine whether Grok’s AI features facilitate the production and dissemination of illegal content.

European Union officials are reported to have focused the investigation on whether the X platform and Grok fulfill their obligations to identify, assess, and mitigate systemic risks. Within this framework, the impact of AI-based image generation tools on the platform has been examined in detail.

The investigation conducted by the European Union is said to have evaluated the following areas:

• The generation and dissemination of sexualized and digitally manipulated images,
• Measures to prevent content targeting women and minors,
• The adequacy of the X platform’s risk assessment processes and risk mitigation mechanisms.

The investigation is reported to have placed particular emphasis on risks related to sexual content targeting children, noting that deficiencies in oversight in this area carry specific significance under the Digital Services Act.

The investigation under the Digital Services Act is said to potentially result in substantial administrative fines in the event of violations. It is stated that under EU legislation, such penalties may be calculated based on the global annual turnover of the relevant companies. Furthermore, it is indicated that regulatory authorities may impose additional obligations or technical requirements on the platform if deemed necessary.

The investigations into Grok are said to have reignited debates on the legal and regulatory responsibilities arising from AI tools in content generation. It is reported that the regulation of image generation technologies, platform accountability for content, and the保障 of user safety have been central to the inquiry processes.

When initiating the investigation, the European Union is noted to have placed special emphasis on Grok’s potential to generate deepfake content featuring minors, identifying this risk as one of the decisive factors in its regulatory assessment.

According to media reports, following the initiation of the investigations, X and xAI implemented technical restrictions on certain image generation and editing functions of Grok. These restrictions are said to aim at preventing the production of sexualized and manipulative imagery.

However, authorities in both the United States and the European Union are reported to continue assessing the adequacy and durability of these technical adjustments. The investigations are said to be framed as part of a broader legal framework for regulating AI-based content generation.