Grok, kecerdasan buatan di bawah naungan Musk, memicu kontroversi eksploitasi AI, Eropa, India, dan Malaysia memulai penyelidikan di berbagai negara

Elon Musk’s community platform X (formerly Twitter) and its AI chatbot Grok recently fell into a sexual exploitation storm. The platform allowed users to create and share AI-generated sexualized images of children and women through Grok, attracting strong attention and investigations from regulatory agencies in multiple countries worldwide. The EU, India, Malaysia, and Brazil have all taken action, demanding the platform review related features and even suspend their use. Despite the ongoing controversy, X platform traffic and downloads surged against the trend, raising more questions and concerns externally.

Grok sparks controversy: AI-generated sexual images become global focus

X platform recently became an international news focal point due to controversy sparked by its AI chatbot Grok. According to multiple media reports, users could use Grok’s “Imagine” feature to input prompts and generate sexualized images based on real people, even including suspected child sexual exploitation content. These AI-created images were widely shared on the X platform, forming a so-called “non-consensual intimate images” (NCII) dissemination wave.

EU outraged: calls it “illegal and disgusting”

The EU paid close attention to this incident, with EU Commission spokesperson Thomas Regnier emphasizing at Monday’s press conference: “This is not some ‘spicy mode,’ this is illegal, shameful and disgusting behavior, and such content has no place in Europe.” He confirmed the EU is investigating this matter “very seriously,” specifically naming Grok for launching modes with explicit content, even featuring child-like imagery.

UK media regulator Ofcom also stated it had formally requested relevant information from X about Grok, investigating whether it violates UK law and platform safety standards.

Asian action: India and Malaysia launch investigations with deadline demands for improvement

The Indian government similarly demonstrated a tough stance, with the Ministry of Electronics and Information Technology (MeitY) ordering X to complete a “comprehensive technical, procedural and governance-level review” by January 5 to ensure the platform complies with Indian cyber security standards.

Malaysia’s Communications and Multimedia Commission (MCMC) announced an investigation last weekend and will summon X company representatives. The MCMC stated: “All platforms accessible in Malaysia should implement protective mechanisms consistent with local laws, particularly for AI-driven features, chatbots and image processing tools.”

Brazil and US join attention: demand suspension of Grok use

In South America, a female congressman in Brazil publicly called on the country’s federal prosecutors and data protection institutions to suspend Grok use until investigation results are released.

On the US side, the national nonprofit “National Center on Sexual Exploitation” (NCOSE) called on the Department of Justice (DOJ) and Federal Trade Commission (FTC) to investigate. The organization’s legal director Dani Pinter pointed out that although existing laws lack specific precedents on such AI-generated images, if images can identify children or depict minors engaged in sexual conduct, it constitutes a violation.

A DOJ spokesperson told media: “The Department of Justice takes an extremely serious stance on AI-generated child sexual exploitation content and will actively prosecute anyone manufacturing or possessing CSAM (child sexual abuse material).”

Musk himself responds casually: responds to controversy with “funny pictures”

Although the outside world paid close attention to and condemned harmful content on the X platform, Musk himself seemed not to view the incident as a serious problem. He posted a series of funny pictures generated by Grok on his personal account, which even included simulated images of himself wearing a bikini, accompanied by laughing-crying emojis, drawing criticism from safety experts and commentators as “reckless and irresponsible.”

X company responds: “has taken action,” but lacks specific measures

X company first responded to the incident on Saturday through the official “X Safety” account, stating it will take action against illegal content, including deleting CSAM, permanently suspending violating accounts, and cooperating with law enforcement. Musk added: “Anyone using Grok to generate illegal content faces the same consequences as directly uploading illegal content.”

However, the outside world questions whether its measures are sufficient. An xAI employee, Ethan He, stated on X that the Grok Imagine feature has been updated, but did not specifically clarify whether restrictions on generating explicit images were implemented.

AI content review deficiencies? Industry experts point directly at “basic protections missing”

Musubi AI CEO Tom Quisel criticized xAI for not establishing “entry-level trust and safety protection mechanisms” when launching Grok Imagine. He stated that technically it’s possible to simply identify and block images containing children or nudity, and can also detect inappropriate content in user prompts and refuse to generate.

Controversy attracts followers instead? Grok and X downloads surge significantly

Despite ongoing controversy, usage of Grok and X showed no obvious decline. According to mobile app data company Apptopia, daily Grok downloads have grown 54% since January 2, while X platform downloads also rose 25% over the past three days.

This unusual growth trend has left many observers concerned that the platform may be intentionally tolerating controversy to stimulate discussion and user activity.

This article, “Elon Musk’s AI Grok sparks AI sexual exploitation controversy, Europe, India, Malaysia launch multi-country investigations,” first appeared on Chain News ABMedia.