The UK government is intensifying pressure on the communications regulator Ofcom to take decisive action against X, a social media platform owned by Elon Musk, over the creation of unlawful AI-generated images. The controversy centers around Grok, an AI tool developed by Musk's company xAI, which has been used to produce sexualised and violent imagery without consent.

Government Calls for Strong Measures

Prime Minister Keir Starmer has publicly denounced the use of Grok for generating explicit images, describing the content as "disgraceful" and "unlawful." He emphasized the government's support for Ofcom to explore all available options, including an effective ban on X, to curb the spread of such content. "It's disgusting. X needs to get their act together and get this material down," Starmer stated, underscoring the urgency of the situation.

Ofcom's Regulatory Powers

Ofcom, under the Online Safety Act, possesses significant regulatory powers, including the ability to obtain court orders to restrict access to non-compliant platforms. While these powers are rarely exercised, they can be expedited in cases involving serious harm or risks to children. The regulator has already initiated an investigation and made urgent contact with X and xAI to address the concerns.

Grok's Response to Backlash

In response to mounting criticism, Grok has restricted its image creation capabilities to paying subscribers, effectively limiting access for the majority of users. This move aims to mitigate the misuse of the tool, as subscribers' details and payment information are stored, allowing for identification if the function is abused. Despite these measures, the platform continues to face global regulatory scrutiny.

Broader Implications for Tech Regulation

The situation highlights the broader challenges of regulating AI technologies and social media platforms. The UK government's stance reflects growing concerns about internet safety and the potential misuse of AI tools. As Ofcom recruits a new chair, expectations are high for a more robust approach to addressing these issues, with the Online Safety Act serving as a pivotal framework for action.