KUALA LUMPUR – The Malaysian Communications and Multimedia Commission (MCMC) has issued a stern warning in response to growing public concerns over the misuse of artificial intelligence (AI) tools on the social media platform X.
The complaints specifically highlight the digital manipulation of images, where AI was used to alter pictures of women and minors, turning them into explicit, offensive, or otherwise harmful content.
In a statment, MCMC emphasised that the creation or distribution of such material is a violation of Section 233 of the Communications and Multimedia Act 1998 (CMA).
This law prohibits the transmission of grossly offensive, obscene, or indecent content via network or application services. As such, MCMC has vowed to launch investigations into users on X suspected of breaching these regulations.
In line with the newly enforced Online Safety Act 2025 (ONSA), all licensed online platforms and service providers are required to take proactive measures against the spread of harmful content, including indecent material and child sexual abuse content. Although X is not yet a licensed service provider, it remains responsible for safeguarding its platform against harmful content. MCMC is currently investigating instances of online harm within X and plans to summon its representatives for discussions.
MCMC urged all platforms available in Malaysia to implement robust safety measures that align with local laws and online safety standards, particularly concerning AI-driven features such as chatbots and image manipulation tools. Internet users and victims are encouraged to report harmful content directly to the platform and to lodge complaints with both the Royal Malaysia Police (PDRM) and MCMC through the commission’s online complaints portal.
Elon Musk’s Grok AI, which has faced heavy scrutiny, acknowledged flaws after users claimed it had been used to alter images of children and women into explicit content. Grok issued a statement, acknowledging lapses in its safeguards and promising swift corrective action.
“We’ve identified lapses in safeguards and are urgently fixing them,” Grok’s team stated on X, after the tool was used to transform images into erotic versions, including of minors.
Complaints began to surface after Grok introduced a new “edit image” button in late December. This feature allowed users to modify any image on the platform, including some disturbing instances where the clothing was removed from women or children’s photos. The button’s misuse led to widespread criticism.
In response, Grok’s parent company, xAI, maintained an aggressive stance, with an automated reply claiming “the mainstream media lies.” However, the company did acknowledge that generating images of underage girls violated both its internal guidelines and US law concerning child sexual abuse material (CSAM).
Elsewhere, governments around the world have taken action. In India, the Ministry of Information Technology has demanded that X quickly provide an action report outlining measures taken to prevent the generation and spread of harmful and indecent content on the platform. French prosecutors have also expanded their investigation into X, focusing on the use of Grok for generating and distributing illegal content.
In Malaysia, a lawyer has offered guidance to victims, particularly women, who have fallen prey to the AI tool’s misuse.
According to the NST, Lawyer Azira Aziz advised that the first step for victims is to report the offending posts directly to X, ensuring they capture evidence in the form of screenshots and links. These can then be submitted as part of a formal complaint to MCMC.
Azira also recommended that victims file a police report and provide the collected evidence as supporting documentation. However, some victims have reported difficulties, with several international complaints being dismissed by X on the grounds that the content did not breach community guidelines.
Grok’s recent history of generating controversial and damaging content is not limited to this incident. The AI chatbot has previously been criticised for spreading inflammatory statements on various geopolitical issues, including the Gaza conflict and India-Pakistan tensions, as well as antisemitic remarks. – January 3, 2025