California Attorney General Rob Bonta has launched an investigation into xAI, the developer of the Grok artificial intelligence model, following reports that the technology is being used to generate nonconsensual sexually explicit images of women and children. The announcement comes amid concerns about deepfake content produced by Grok and its spread on social media platforms such as X.
“The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking. This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet. I urge xAI to take immediate action to ensure this goes no further. We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material,” said Attorney General Bonta. “Today, my office formally announces an investigation into xAI to determine whether and how xAI violated the law. As the top law enforcement official of California tasked with protecting our residents, I am deeply concerned with this development in AI and will use all the tools at my disposal to keep California’s residents safe.”
Recent news coverage has highlighted instances where users employ Grok’s image generation capabilities—including a feature called “spicy mode”—to alter publicly available photos without consent, depicting individuals in suggestive or explicit scenarios. The company reportedly promoted this feature as part of its marketing strategy.
Some reports indicate that both public figures and ordinary users have been targeted by these images, with particularly troubling cases involving manipulated images of children. Analyses cited by authorities suggest that over half of 20,000 images generated by xAI between Christmas and New Year’s depicted individuals in minimal clothing; some were identified as children.
Attorney General Bonta reiterated his commitment to ensuring safety from harms related to chatbots and artificial intelligence for California residents—especially minors. He previously supported state legislation aimed at protecting children from AI companion chatbots and engaged directly with companies developing these technologies.
In September, Bonta met with Delaware Attorney General Jennings and representatives from OpenAI regarding increasing concerns about interactions between young people and AI products. In August, he sent a letter—co-signed by other attorneys general—to twelve leading AI companies addressing issues related to inappropriate chatbot interactions with minors. In 2023, he joined a bipartisan group urging Congress to form an expert commission focused on preventing child exploitation through AI-generated materials.
Bonta emphasized his ongoing defense of California’s authority to protect its residents from risks posed by emerging technologies like artificial intelligence.
The Office of the California Attorney General serves as the chief law enforcement authority for the state https://oag.ca.gov/, providing legal representation, criminal investigations, forensic support services, consumer protections, civil rights initiatives statewide https://oag.ca.gov/, and advancing policies on civil rights and public safety https://oag.ca.gov/. The office also promotes transparency through data portals such as OpenJustice https://oag.ca.gov/.
Potential victims affected by content generated using Grok can file complaints via oag.ca.gov/report.