United States of America: California Attorney General announced investigation into xAI regarding alleged production of non-consensual sexually explicit material and child sexual abuse material by Grok AI

Description

California Attorney General announced investigation into xAI regarding alleged production of non-consensual sexually explicit material and child sexual abuse material by Grok AI

On 14 January 2026, the California Attorney General announced an investigation into xAI over its AI model Grok, which is reportedly being used to create and spread non-consensual, sexually explicit deepfake images of women and children, including via social media platform X. The probe focuses on whether xAI violated laws by enabling the mass production of such material through a feature marketed as "spicy mode," which generates explicit content. The Attorney General emphasised zero tolerance for AI-generated harassment and child sexual abuse material, urging immediate action from the company.

Original source

Scope

Policy Area
Content moderation
Policy Instrument
Content moderation regulation
Regulated Economic Activity
platform intermediary: user-generated content, ML and AI development
Implementation Level
subnational
Government Branch
executive
Government Body
central government

Complete timeline of this policy change

Hide details
2026-01-14
under deliberation

On 14 January 2026, the California Attorney General announced an investigation into xAI over its AI…

2026-01-16
under investigation

On 16 January 2026, the California Attorney General's office issued a cease and desist letter to xA…