Indonesia Threatens to Block Grok AI for Inappropriate Content
Indonesia is considering banning Elon Musk's Grok due to degrading images of women and children.
The Indonesian Ministry of Communications announced on Wednesday its threat to block Elon Musk's platform X and its artificial intelligence chatbot, Grok, following the increasing dissemination of degrading images of women and children generated without consent on the social network.
Grok is accused of responding to requests from X users by altering real images of women and children, reducing them to being dressed only in underwear. This phenomenon, which has gone viral, raises significant global concern.
A Revealing Investigation
A preliminary investigation conducted by the ministry revealed that Grok "does not yet have explicit and adequate regulations to prevent the production and distribution of pornographic content based on real photos" of Indonesian citizens, according to a statement from the Ministry of Communications and Digital Affairs.
Indonesia, known for its strict laws against the production and dissemination of pornographic content, reminded that digital service providers operating within its territory must comply with its regulations. "The obligation to comply with Indonesian laws and regulations applies to all digital platforms operating in Indonesia," the ministry emphasized.
In case of non-compliance or insufficient cooperation, Indonesian authorities warned that they could impose administrative sanctions, including the suspension of access to Grok's AI services and the X platform.
Alarming Figures
Concern has intensified following an update to the chatbot in December, which facilitated the submission of photographs by users to request the removal of clothing from images. A report published on Tuesday by the European non-profit organization AI Forensics revealed that Grok "systematically undresses women."
Analysis of 20,000 images generated by Grok between December 25 and January 1 showed that 53% of them contained individuals in minimal attire, of which 81% were women. Additionally, 2% of the photos depicted individuals appearing to be 18 years old or younger.
Measures and Calls for Responsibility
The Indonesian Ministry of Communications also reminded that AI service providers, as well as their users, could face administrative or criminal sanctions if they produce or disseminate pornographic content, or modify personal images without authorization.
"Every digital platform must ensure that the technology it offers does not become a means of violating privacy, sexual exploitation, or degrading a person's dignity," said Alexander Sabar, the Director General of the Digital Space at the ministry.
He added, "We urge all parties to use artificial intelligence technology responsibly. The digital space is not a lawless area; the privacy and image rights of every citizen must be respected and protected."
Growing Global Pressure
Indonesia thus joins a growing list of countries, including Malaysia, India, and France, that are calling for investigations or considering actions against Grok. These initiatives reflect increasing concerns about the inappropriate uses of artificial intelligence technologies and the potential violations of fundamental rights they may engender.
Yohann B.
