Regulators around the world are scrutinizing Grok over sexual deepfakes

Regulators around the world are scrutinising Grok over sexual deepfakes, as Grok’s failure to block sexualised images of minors has turned an isolated lapse into a global regulatory stress test for xAI’s ambitions. Last week the site noted Grok’s apology following its paid “Spicy Mode” launched in August 2025, which enabled users to generate sexual deepfake images that could breach laws in the US and other jurisdictions.

A report from web-monitoring tool CopyLeaks highlighted thousands of incidents of Grok being used to create sexually suggestive images of non-consenting celebrities. In the United States, three senators are reportedly calling on Google and Apple to remove Grok and its X app from their app stores, arguing the content violates store rules.

The UK government has signalled it would support action by Ofcom, while regulators in Indonesia and Malaysia have already blocked Grok, and Grok/X later announced limits on image generation for paying subscribers only.