The social media platform X, owned by Elon Musk, is under intense scrutiny following reports that its AI tool, Grok, has been used to create non-consensual, sexualized images of women and children. Prime Minister Keir Starmer has publicly condemned these AI-generated deepfakes as "disgusting" and "shameful," emphasizing the need for X to comply with UK law.

Government and Regulatory Response

The UK media regulator Ofcom has initiated a formal investigation into X after a surge of manipulated images appeared on the platform. The investigation aims to determine whether X has violated the Online Safety Act, which criminalizes the creation of non-consensual intimate images. If found guilty, X could face fines up to 10% of its global revenue or £18 million, whichever is greater. Ofcom also holds the authority to block access to X in the UK if compliance is not achieved.

X's Actions and Public Reaction

In response to the backlash, X has reportedly limited the capabilities of its Grok AI tool, preventing it from generating images of real people in revealing clothing. Elon Musk, addressing the controversy, stated that Grok is programmed to adhere to the laws of each country and does not produce illegal content. However, public sentiment remains critical, with 58% of Britons supporting a ban on X if it fails to curb the misuse of AI-generated images.

Legal and Ethical Implications

The controversy has sparked a broader discussion about the ethical use of AI technology. Government officials have expressed frustration over the lack of preventive measures that other AI providers have implemented. The situation has prompted calls for stronger legislation to address the potential misuse of AI, with Starmer affirming the government's commitment to strengthening existing laws if necessary.