KUALA LUMPUR – The Malaysian Communications and Multimedia Commission (MCMC) has ordered temporary restrictions on access to Grok, an artificial intelligence tool developed by xAI and integrated into X, after repeated misuse involving obscene and harmful content.
In a statement today, MCMC said the restriction took effect on January 11 and follows the failure of X Corp. and xAI LLC to implement effective technical and moderation safeguards, despite prior regulatory engagement and formal notices.
The regulator said Grok had been repeatedly misused to generate obscene, sexually explicit, indecent and grossly offensive content, including non-consensual manipulated images involving women and minors.
MCMC said it had issued notices to X Corp. and xAI on January 3 and January 8, demanding the implementation of safeguards to prevent AI-generated content that may contravene Malaysian law, including Section 233 of the Communications and Multimedia Act 1998.
However, responses submitted by X Corp. on January 7 and January 9 relied largely on user-initiated reporting mechanisms and failed to address risks inherent in the design and operation of the AI tool.
“This is insufficient to prevent harm or ensure compliance with Malaysian law,” MCMC said.
The commission said the restriction was imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing, and will remain in place until effective safeguards are implemented, particularly to prevent content involving women and children.
Report harmful content
MCMC added that it remains open to engagement with X Corp. and xAI, subject to demonstrable compliance with Malaysian laws and regulations.
The move follows earlier warnings by MCMC over the abuse of generative AI tools after Grok was found to have produced explicit images, prompting the regulator to caution platforms against allowing AI systems to be used to generate illegal and harmful content.
Members of the public were urged to report harmful online content to MCMC and, where appropriate, lodge police reports with the Royal Malaysia Police.
Previously, Grok AI, owned by Elon Musk, acknowledged flaws after users claimed it had been used to alter images of children and women into explicit content. Grok issued a statement, acknowledging lapses in its safeguards and promising swift corrective action.
“We’ve identified lapses in safeguards and are urgently fixing them,” Grok’s team stated on X, after the tool was used to transform images into erotic versions, including of minors.
Complaints began to surface after Grok introduced a new “edit image” button in late December. This feature allowed users to modify any image on the platform, including some disturbing instances where the clothing was removed from women’s or children’s photos. The button’s misuse led to widespread criticism.
In response, Grok’s parent company, xAI, maintained an aggressive stance, with an automated reply claiming “the mainstream media lies.” However, the company did acknowledge that generating images of underage girls violated both its internal guidelines and US law concerning child sexual abuse material (CSAM).– January 11, 2026