Indonesia, Malaysia Ban Grok Over Safety Concerns as Global Regulatory Probes Intensify
Indonesia and Malaysia have blocked access to X’s artificial intelligence chatbot Grok amid mounting concerns over its ability to generate sexualised and non-consensual content, while regulators in the United Kingdom and Europe have launched formal investigations that could lead to further restrictions or bans.
According to international media reports, authorities in Indonesia and Malaysia imposed the bans after concluding that Grok’s existing safety mechanisms were ineffective, particularly in preventing the creation of sexual deepfakes. Regulators in both countries said the temporary bans would remain in place until X’s AI company, xAI, introduces safeguards that meet regulatory and legal requirements.
Also Read:
Indonesia’s Minister of Communication and Digital Affairs, Meutya Hafid, said the government considers the creation of non-consensual sexual deepfakes a serious violation of human rights, personal dignity and public safety in the digital space. She noted that Indonesia enforces strict internet censorship laws, especially against pornographic material, and stressed that AI tools operating in the country must comply with these standards.
Malaysia has also initiated investigations into the misuse of artificial intelligence tools on X, as part of broader regulatory action in the region. These developments follow a notice issued by India’s Ministry of Information Technology, which directed X to take immediate steps to address alleged misuse of Grok, warning of potential violations of the country’s Information Technology Act.
Scrutiny of Grok has extended beyond Southeast Asia, with regulators across Europe stepping up oversight. The Paris prosecutor’s office has confirmed that French authorities, along with other foreign governments, are examining xAI’s technology and its compliance with online safety laws. Parallel probes are underway at the European Union level, while the United Kingdom has emerged as a key centre of regulatory action.
On Monday, UK media regulator Ofcom launched a formal investigation into X over Grok’s image-generation feature, citing reports that the tool had been used to create sexualised deepfakes of women and children. Ofcom described the allegations as deeply concerning, warning that such content may constitute intimate image abuse, pornography or child sexual abuse material under British law.
Ofcom said it had contacted X on January 5 to seek explanations on the measures taken to protect UK users. While the regulator did not disclose details of the response, it confirmed that X replied within the required timeframe. The ongoing investigation will assess whether X has failed to comply with its legal obligations under the UK’s Online Safety Act.
Prime Minister Keir Starmer’s office welcomed the probe, with a Downing Street spokesperson stating that Ofcom has full government backing to take any action it deems necessary. The spokesperson added that the government would not hesitate to strengthen laws further to protect children online if required.
Under Britain’s Online Safety Act, which came into force in July, digital platforms hosting potentially harmful content are required to implement strict age-verification measures. The law also makes it illegal to create or share non-consensual intimate images or AI-generated child sexual abuse material. Ofcom has the authority to impose fines of up to 10 percent of a company’s global revenue for violations.
The controversy has been further fuelled by recent research showing that Grok’s image-generation features, on both desktop and mobile versions, were capable of producing sexually violent and explicit content despite built-in safeguards. The findings indicated that the tool could depict celebrities in sexual scenarios and potentially generate AI-created child sexual abuse material. Researchers also documented cases where Grok fulfilled user requests to digitally undress individuals appearing in publicly available images without their consent.
Amid the backlash, X introduced a new monetisation policy late last week, limiting Grok’s use to paying subscribers. UK Prime Minister Keir Starmer criticised the move, calling it an affront to victims and saying it did not address the underlying safety concerns.
X owner Elon Musk has pushed back against the growing regulatory pressure, accusing governments, particularly in the UK, of attempting to suppress free speech. In posts on X, Musk claimed authorities were seeking excessive censorship, although he has previously stated that users who upload illegal content should face consequences.
Meanwhile, the European Commission has ordered X to preserve all internal documents and data related to Grok until the end of 2026 as investigations continue. European Commission President Ursula von der Leyen said child protection and consent would not be left to technology companies alone, warning that regulators would act if firms failed to do so.
Read all the Breaking News Live on pakistantimes.com and Get Latest English News & Updates from Pakistan Times. Follow us on Whatsapp channel for more.
