South Korea calls on X to protect minors from Grok deepfakes

By Seyit Kurt

ISTANBUL (AA) - South Korea’s media watchdog has asked US social media company X to implement measures aimed at protecting minors from sexually explicit content generated by its AI chatbot Grok, according to the Yonhap news agency.

The Korea Media and Communications Commission said Wednesday it delivered the request to X’s operator amid growing public alarm over AI tools being used to create non-consensual sexual imagery.

In a statement, the commission said it asked X to prevent potential illegal activities on Grok and to present steps to protect teenage users from harmful content, including restrictions or controls on access for minors.

Under South Korean law, operators of social networking platforms, including X, are required to appoint an official responsible for minor protection and submit an annual compliance report to authorities, the commission said.

The watchdog also noted that producing, distributing or storing sexual deepfake content without consent is subject to criminal punishment under local regulations.

Commission Chair Kim Jong-cheol said the agency aims to support the healthy and safe development of new technologies while addressing their negative side effects.

“As for side effects and negative impacts, we plan to introduce reasonable regulations and revamp policies to prevent the circulation of illegal information, including sexual abuse content, and require AI service providers to protect minors,” Kim said.

Launched in 2023, Grok is available through X and allows users to ask questions and generate content. Its image-generation features enable users to modify real photographs or create AI-generated visuals, which regulators say can be misused to produce non-consensual and sexually explicit content.

Several countries have stepped up action against Grok, with Indonesia and Malaysia blocking access to the AI chatbot last weekend over concerns related to non-consensual sexual deepfakes and other harmful content.

In Europe, authorities in countries including the UK and France have launched investigations into the platform, citing potential violations of laws governing online safety, privacy and the protection of minors.