EU Investigates X Over Grok’s Deepfake Sexual Imagery Concerns

The European Commission has launched an investigation into X after concerns arose regarding its GenAI model Grok, which reportedly enabled users to generate sexually explicit imagery, including sexualized images of children. This investigation falls under the Digital Services Act (DSA), a regulation enacted in 2022 aimed at controlling illegal content and systemic risks on online platforms.

The DSA empowers the EU to impose fines of up to 6% of a company’s total annual worldwide turnover for violations. In X’s case, this could amount to approximately $174 million, based on its estimated turnover of $2.9 billion. The Commission’s inquiry will assess whether X adequately evaluated and mitigated the risks associated with Grok’s functionalities.

Henna Virkkunen, the Commission’s executive vice-president for tech sovereignty, security, and democracy, emphasized the seriousness of the risks posed by Grok, stating that sexual deepfakes represent a violent degradation of individuals, particularly women and children. The investigation aims to determine if X has fulfilled its legal obligations under the DSA.

X has responded by reiterating its commitment to maintaining a safe platform, stating it has a zero-tolerance policy for child sexual exploitation and non-consensual nudity. The company claims to take action against violative content and reports such accounts to law enforcement as necessary.

Since discussions began with the EU regarding Grok, X has made changes, including disabling the image-generation tool for non-subscribers. However, the Commission’s investigation encompasses broader aspects beyond this specific incident.

In addition to this investigation, the EU has extended proceedings initiated against X in December 2023 to evaluate the platform’s overall risk assessment and mitigation strategies, particularly concerning its switch to Grok-based recommendations. Previously, the EU fined X €120 million for breaches related to ad transparency and data access.

The EU’s firm stance against US tech giants has drawn criticism from the US Trade Representative, who argues that such regulations may hinder the competitiveness of American companies. The ongoing scrutiny of X highlights the increasing regulatory pressures on digital platforms in Europe.

• X: The platform, previously known as Twitter, is under investigation for enabling the generation of explicit imagery through its GenAI model Grok.
• Grok: A GenAI model that reportedly allows users to create sexually explicit images, raising concerns about child sexual exploitation.
• Digital Services Act (DSA): A regulation enacted in 2022 to control illegal content and systemic risks on online platforms.
• Henna Virkkunen: The EU Commission executive vice-president who commented on the investigation’s implications for citizen rights.
• €120 million: The fine previously imposed on X for breaching DSA regulations regarding ad transparency and data access.