Addressing Digital Abuse and Supporting Survivors

As an advocate for survivors of domestic violence, the lesson is clear: while technology evolves, patterns of violence do not. People continuously find new ways to inflict harm. In the 1980s, Polaroid cameras allowed abusers to document exploitation privately. The 1990s saw Caller ID become a tool for stalkers to trace those trying to escape. By the 2010s, smart technology, including doorbell cameras and location surveillance apps, gave abusers updated methods for control.

A new concern has emerged recently: the rise of ‘nudify’ and ‘kissing’ apps online. These tools use AI to create fake intimate images of individuals without their consent, rapidly spreading across the internet. Such actions are not just unethical; they are often illegal. Sharing any real or falsified intimate photos without permission can have devastating consequences. Women and girls remain most affected by this worrying trend.

Efforts are underway to counter these apps and those who develop or market them. Safety teams use AI to review and detect content that may disguise harmful intent, often hidden with emojis or coded language, under the guise of innocuous photo-editing applications.

Tech companies play a crucial role by enhancing prevention and reporting tools for survivors. They must collaborate with others, including nonprofits and law enforcement, to ensure that perpetrators face accountability. These companies continuously seek methods to identify and remove harmful content online. Behind many such malicious websites are determined individuals looking for ways to bypass rules.

Collaboration across tech firms and civil organizations is vital. The Tech Coalition’s Lantern program enables companies to share information about violating apps, investigating and acting accordingly. This helps prevent the spread of nonconsensual images.

Awareness of protective tools is essential. Survivors and at-risk individuals should know available resources. Platforms like StopNCII.org allow secure reporting of nonconsensual image sharing. Support for legislation such as the Take It Down Act is critical, offering victims more tools and reporting avenues.

Taking legal action against those promoting and producing nonconsensual content is another key strategy. Meta has pursued a lawsuit against Joy Timeline HK Limited, the creator of CrushAI apps, for advertising apps that generate explicit images without consent. An initial court hearing recently took place to address the next steps.

Initiatives like these form part of a greater effort to support survivors. Persistence is crucial in addressing digital abuse and putting control back in survivors’ hands. For those facing threats regarding intimate images online, resources like StopNCII.org and TakeItDown.NCMEC.org are valuable.

Cindy Southworth, Head of Women’s Safety at Meta and former Executive Vice President of the National Network to End Domestic Violence, emphasizes this commitment. The perspectives shared here reflect her views.