The City Attorney of San Francisco has taken a bold stand against the tech industry’s most insidious tools. This week, David Chiu’s office sent cease-and-desist letters to Apple and Google, demanding they immediately remove 13 AI-powered “nudify” apps from their app stores. These apps, marketed as “face-swap” tools, are being used to create non-consensual nude images of women and girls, often without their knowledge or consent.
The Apps That Strip Dignity Without Consent
The 13 apps identified by the City Attorney’s Office use artificial intelligence to digitally remove clothing from photos, creating realistic nude images of the person in the original picture. While the apps are framed as entertainment or “deepfake” tools, their primary use is overwhelmingly malicious. The letters argue that these apps are a direct enabler of harassment, blackmail, and psychological abuse, with women and girls bearing the brunt of the harm.
Why San Francisco Is Holding Apple and Google Accountable
The city’s legal argument is straightforward: Apple and Google are not neutral platforms. They control the app stores, approve each app, and take a 15% to 30% commission on all in-app purchases. By hosting and profiting from these “nudify” apps, the city argues, the tech giants are violating their own policies against non-consensual intimate imagery and are complicit in the harm caused. “These apps are designed for one purpose: to create non-consensual, sexually explicit images of real people,” the letter states.
The Human Cost of a Few Lines of Code
Behind the legal jargon is a deeply personal crisis. Victims of these apps often discover their images circulating online, used for blackmail, social humiliation, or simply as a tool of control. The psychological toll is immense—anxiety, depression, and a sense of violation that lingers long after the image is removed. For young women and teenage girls, the fear of being targeted can alter their behavior, limiting their online presence and social interactions. The City Attorney’s Office emphasized that this is not a hypothetical problem; it is a growing crisis that demands immediate action.
Apple and Google’s Silence Speaks Volumes
As of this report, neither Apple nor Google has issued a public response to the specific demands. Both companies have previously stated they prohibit non-consensual intimate imagery on their platforms, but critics argue that enforcement has been slow and inconsistent. The letters give the companies a clear deadline to act, but the city has not disclosed the exact timeline. If the companies fail to comply, San Francisco could escalate the matter through legal channels, including potential lawsuits or regulatory complaints with state and federal authorities.
Why These Apps Exist Despite Existing Policies
The apps in question often use vague descriptions and avoid explicit keywords to slip through app store review processes. They may be listed as “photo editing” or “face-swap” tools, with the nudify feature hidden behind a paywall or a separate interface. This deliberate obfuscation makes it difficult for automated review systems to catch them. The City Attorney’s Office argues that Apple and Google have the resources to conduct more thorough human reviews but have chosen not to, prioritizing profit over safety.
Confirmed Facts vs What Remains Unclear
Confirmed: The City Attorney’s Office sent cease-and-desist letters to Apple and Google regarding 13 specific apps. The apps are used to create non-consensual nude images, predominantly targeting women and girls. The letters argue the companies are profiting from these apps.
Unclear: The exact names of the 13 apps have not been publicly disclosed. Apple and Google’s official response is pending. The timeline for compliance has not been specified. It is also unclear whether the companies will voluntarily remove the apps or contest the city’s demands.
The Broader War Against AI-Generated Abuse
This action is part of a larger, global pushback against AI-generated non-consensual intimate imagery. In recent months, the U.S. Federal Trade Commission has warned about the rise of “deepfake” abuse, and several states have passed laws criminalizing the creation and distribution of such images. The UK has also introduced legislation targeting the same issue. San Francisco’s move is significant because it directly targets the distribution channels—the app stores—rather than just the creators of the apps. It signals a shift in accountability toward the platforms that enable the abuse.
What This Means for Users and Parents
For everyday users, this action is a reminder that the apps on your phone are not always what they seem. Parents should be aware that “photo editing” or “face-swap” apps can be used maliciously. If you or someone you know has been targeted, resources like the Cyber Civil Rights Initiative and local legal aid can provide support. For now, the safest course is to avoid any app that offers to “undress” or “nudify” photos—no matter how it is marketed.
What Happens Next
The ball is now in Apple and Google’s court. If they remove the apps, it will set a powerful precedent for other app stores and platforms. If they resist, it could lead to a protracted legal battle that tests the limits of platform liability. Either way, San Francisco has drawn a clear line: profiting from tools designed to strip away someone’s dignity is not acceptable, and the city is prepared to fight for that principle.
Our Take
This is not just a legal dispute; it is a moral reckoning for the tech industry. Apple and Google have long positioned themselves as guardians of user safety, but actions like this expose the gap between their rhetoric and their enforcement. The apps in question are not edge cases—they are a direct, foreseeable consequence of AI tools being released without guardrails. San Francisco is right to demand accountability. The real test will be whether the tech giants act swiftly or drag their feet, and whether other cities and states follow San Francisco’s lead.
Frequently Asked Questions
What are “nudify” apps?
These are AI-powered applications that use deepfake technology to digitally remove clothing from photos, creating realistic nude images of the person in the original picture. They are overwhelmingly used to target women and girls without their consent.
Why is San Francisco targeting Apple and Google, not the app developers?
The city argues that Apple and Google control the distribution channels and profit from these apps through commissions. By hosting them, the tech giants are enabling the harm and violating their own policies against non-consensual intimate imagery.
What should I do if I find one of these apps on my phone?
Do not use it. Report the app to Apple or Google through their official reporting channels. If you or someone you know has been victimized, contact the Cyber Civil Rights Initiative or a local legal aid organization for support.
Can Apple and Google be sued for hosting these apps?
Yes, potentially. San Francisco’s cease-and-desist letters are a precursor to possible legal action. The city could file a lawsuit under consumer protection laws or seek regulatory intervention if the companies do not comply.
