On Friday, “Grok,” the AI assistant integrated into the “X” platform, acknowledged the existence of “vulnerabilities” that allowed users to obtain sexually explicit images depicting minors or women. These breaches have sparked global criticism and led to an expansion of a judicial investigation in France.
In response to a user complaint, the “Grok” account on “X” wrote on Friday, days after reports surfaced on the platform: “We have identified vulnerabilities in our safety procedures and are working urgently to fix them. The sexual exploitation of children is illegal and prohibited.”
These reports concern actions by internet users who sent images or videos of real people, including children and teenagers, to “Grok” and requested the AI assistant to modify them to show full or partial nudity.
The AI company that developed “Grok” has not issued any public response to this recent controversy surrounding its assistant, which has faced criticism in recent months for posting controversial replies regarding the war in Gaza, the India-Pakistan conflict, and antisemitic statements.
On Friday, the company sent an automated response to inquiries, stating only that “traditional media lies,” without any additional comment.
However, the company’s automated “Grok” program responded to an internet user, stating that any company in the United States “subjects itself to civil or criminal liability if it knowingly facilitates the production” of child pornography or fails to prevent it.
– French authorities investigate a post by the chatbot “Grok” denying the Holocaust
– Company apologizes for “Grok’s” controversial messages
– Company apologizes for “Grok’s” controversial messages
In addition to minors, “Grok’s” vulnerabilities also affected adult women, as the program digitally altered their images on social media platforms at the request of internet users to undress them.
From France to India
On Friday, India’s Ministry of Electronics and Information Technology issued an official notice to “X,” demanding that the platform submit a detailed report within 72 hours on the measures taken to remove “obscene, nude, inappropriate, and sexually explicit content” created by the Grok application without the consent of the women concerned, according to a letter published in the Indian press.
In France, the Paris public prosecutor’s office expanded an investigation targeting the “X” platform on Friday to include the integrated AI tool “Grok.” This followed reports from three ministers and two members of parliament that it had generated and disseminated fake sexual videos “particularly depicting minors.”
The ministers and MPs complained that deepfake videos of a sexual nature, created using “Grok,” were being published on “X” without the consent of the individuals depicted.
This investigation targeting “X” was opened in July following complaints against the social network and its officials, accusing them of manipulating the platform’s algorithm.
The public prosecutor’s office clarified that “the crime of creating sexually explicit images or videos of a person without their consent is punishable by two years in prison and a fine of 60,000 euros,” confirming a report.
On Friday, two MPs filed a legal complaint, leading to the expansion of the investigations.
Also on Friday, three ministers announced that they had reported “illegal content” to the public prosecutor’s office, demanding its “immediate removal.”
