The alarming rise in AI-generated deepfake imagery has prompted a surge in victims seeking support, particularly in Guernsey, where the Victim Support and Witness Service has noted an increase in reports. Jenny Murphy, who manages the service, expressed concern over the growing misuse of artificial intelligence to create sexual images without consent. Currently, Guernsey's Sexual Offences Law 2020 criminalizes the sharing of intimate images without consent but does not address the creation of such images using AI. The Home Affairs Committee is considering legal reforms to close this gap.

Legal Reforms and Challenges

In the UK, the government is moving to criminalize the creation of nonconsensual sexual images, a step experts say is crucial as the misuse of AI to harm women is only beginning. Despite some AI tools having strict safeguards, others, like Grok, are exploited to generate explicit images. Users on platforms like Reddit and Telegram share techniques to bypass these safeguards, raising concerns about the effectiveness of current regulations.

The Global Nature of AI Misuse

The global nature of AI-generated nonconsensual imagery presents significant challenges for regulation and enforcement. Sophie Mortimer, manager of the UK's Revenge Porn helpline, highlighted the difficulty in tracking perpetrators across different countries and platforms. "We frequently see victims unaware of the imagery created, complicating reporting and enforcement," she noted.

Growing Ecosystem of Nudification Apps

Research from the Institute for Strategic Dialogue (ISD) reveals a burgeoning ecosystem of nudification apps and websites, with millions of visitors and significant social media activity. Anne Craanen, an ISD researcher, warned of the fertile ground for misogyny these platforms provide, as they increasingly find pipelines to mainstream audiences.