Ofcom will continue probe into X's Grok after image limits

Britain's communications regulator said it will press ahead with a formal investigation into X’s Grok chatbot even after xAI announced new limits on the model’s image-editing capabilities. The regulator opened the probe earlier in the week amid reports that Grok was being used to generate sexually intimate deepfakes, including allegations of non-consensual intimate images and potential child sexual abuse material.

On the evening of Jan. 14 xAI said it had imposed restrictions on Grok users, limiting image editing. Company messaging via the platform’s X Safety account said it had “implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis.” Earlier company communications had indicated image creation and editing would be limited to paid subscribers, but xAI later said the new restriction “applies to all users, including paid subscribers.”

Ofcom welcomed the changes but made clear the new controls would not halt its inquiry. In a statement the regulator said: “This is a welcome development. However, our formal investigation remains ongoing. We are working round the clock to progress this and get answers into what went wrong and what’s being done to fix it.” The probe will examine how Grok was operated and whether X failed to prevent the spread of illegal content under UK law.

The issue has prompted high-level political attention. The British prime minister told parliament that X is “acting to ensure full compliance with UK law” and warned that the government would consider further measures if necessary. Regulators and enforcement agencies in multiple jurisdictions have opened parallel inquiries or taken action, and some countries have temporarily limited access to the service.

In the United States, California officials said they are investigating reports of a large-scale production of non-consensual intimate deepfakes linked to the platform. California’s governor described the conduct as “vile,” accusing the company of creating “a breeding ground for predators.” Those statements underscore the cross-border nature of the response and the growing political pressure on tech firms to police generative AI tools.

Investigations and regulatory responses have also been reported in India, Malaysia, Indonesia, Ireland, France and Australia, and at the European Commission. Indonesia and Malaysia have issued temporary bans on Grok while authorities assess the alleged harms. Paris prosecutors and other national authorities are reviewing possible criminal and regulatory breaches related to sexually explicit deepfakes.

Ofcom has warned X it could face a ban in the UK or a multimillion-pound fine if the platform is found to have failed to protect users from illegal content. The regulator said it will assess xAI’s technical restrictions and public statements as part of the inquiry and determine whether those measures are sufficient to address the harms alleged.

xAI’s founder posted that Grok would “always comply with the law of the countries in which it operates” and that when asked to generate images Grok “will refuse to produce anything illegal.” Regulators, politicians and victims’ advocates will now watch whether those assurances translate into durable technical and policy changes or whether further enforcement actions will be required.