Security AffairsPierluigi Paganini
French authorities investigate AI ‘undressing’ deepfakes on X
French authorities will probe AI-generated sexually explicit deepfakes created with Grok on X after hundreds of women and teens reported manipulated “undressed” images shared on social media. Grok is an artificial intelligence chatbot developed by xAI, the company founded by Elon Musk.
French lawmakers Arthur Delaporte and Eric Bothorel alerted prosecutors on 2 January after thousands of non-consensual sexually explicit deepfakes were generated by Grok and shared on X, with the Paris prosecutor’s office saying the reports were added to an existing investigation into X and that the offence carries penalties of up to two years in prison and a €60,000 fine, according to POLITICO.
Three ministers have reported “manifestly illegal content” linked to Grok to prosecutors and the Pharos platform to secure rapid removal, and France’s High Commissioner for Children condemned the practices. Grok acknowledged isolated cases where users generated AI images of minors in minimal clothing, but said safeguards are in place and are being improved.
The case will bolster the investigation already opened by the French cybercrime unit against X, which was expanded in November to include antisemitic and Holocaust denial statements disseminated by Grok.