San Francisco’s attorney general has drawn a line in the sand: Apple and Google can no longer claim ignorance while AI-powered apps that undress people without their consent thrive in their app stores. This week, David Chiu sent cease-and-desist letters demanding the immediate removal of 13 so-called nudification apps, according to a report from Wired.
What these AI nudify apps actually do
These tools are not harmless filters. They use artificial intelligence to turn ordinary photos of real people into explicit images. With a few taps, a bad actor can remove clothing, alter facial features, place victims in sexualized positions, or swap faces onto naked bodies. The result is non-consensual deepfake pornography — and it is being distributed through official app stores.
Why the attorney general stepped in now
Chiu’s letters warn that Apple and Google are violating California laws that prohibit supporting services that create deepfake pornography. The legal argument is straightforward: by hosting and profiting from these apps, the tech giants are enabling harm. The move signals a shift from relying on companies to self-police to holding them legally accountable for what they distribute.
Who is affected by these apps
The victims are real people — often women, teenagers, and public figures — whose images are stolen and weaponized without consent. The psychological and reputational damage is severe. For many, the knowledge that a fake explicit image of them exists online, created by a stranger, is deeply violating. The apps lower the barrier to committing this abuse, making it accessible to anyone with a smartphone.
What California law says about deepfake pornography
California has been at the forefront of regulating deepfake pornography. State law explicitly prohibits creating or distributing non-consensual deepfake intimate images. Chiu’s letters argue that app stores that host nudification apps are providing a "supporting service" for this illegal activity. The legal theory could set a precedent for how platforms are held responsible for AI-generated abuse.
Confirmed facts vs what remains unclear
Confirmed: Chiu sent cease-and-desist letters to Apple and Google regarding 13 specific nudification apps. The apps can create non-consensual deepfake pornography. California law prohibits supporting services for such content. Unclear: Whether Apple and Google will comply voluntarily. The specific names of the 13 apps have not been publicly disclosed. It is not yet known if the companies have responded to the letters. Any speculation about future legal action remains just that — speculation.
Risks and balanced view
Critics of the legal action may argue that app stores cannot reasonably vet every app for potential misuse. Apple and Google already have policies against non-consensual intimate content, but enforcement has been inconsistent. Some may also question whether the burden should fall on app stores or on the developers who create the tools. However, supporters of Chiu’s move say that profiting from apps whose primary function is abuse is indefensible, and that the law is clear.
Wider trend: AI abuse and platform accountability
This case is part of a growing global reckoning with AI-generated abuse. From deepfake pornography targeting celebrities to AI tools used in schools to create fake images of classmates, the technology is outpacing regulation. Governments in the UK, Australia, and the EU are also exploring laws that hold platforms responsible for hosting AI abuse tools. Chiu’s action could become a template for other jurisdictions.
What readers should know and do
If you or someone you know has been affected by non-consensual deepfake images, resources are available through organizations like the Cyber Civil Rights Initiative. For parents, it is worth discussing with teenagers the risks of sharing photos online, as these apps can target anyone. For app users, reporting suspicious apps to app stores and to law enforcement can help build pressure for removal.
What happens next
Apple and Google now face a choice: remove the apps voluntarily and tighten their review processes, or risk legal action from the San Francisco attorney general. If the companies resist, the case could test the reach of California’s deepfake laws. A court battle would likely focus on whether app stores are merely platforms or active participants in distributing harmful tools.
Our Take
This is not just about 13 apps. It is about whether tech giants will be held accountable for the AI tools they distribute. For years, Apple and Google have positioned themselves as gatekeepers of quality and safety. Chiu’s letters challenge them to live up to that promise. The outcome will matter far beyond San Francisco — it could reshape how app stores around the world handle AI-powered abuse.
Frequently Asked Questions
What are AI nudify apps?
AI nudify apps use artificial intelligence to remove clothing from photos or swap faces onto explicit images, creating non-consensual deepfake pornography. They are designed to target real people without their permission.
Why is the San Francisco AG targeting Apple and Google?
David Chiu argues that by hosting and profiting from these apps, Apple and Google are violating California laws that prohibit supporting services that create deepfake pornography. The cease-and-desist letters demand removal of 13 such apps.
What laws apply to deepfake pornography in California?
California law explicitly prohibits creating, distributing, or supporting services that produce non-consensual deepfake intimate images. Violators can face civil and criminal penalties.
Can Apple and Google be sued for hosting these apps?
Yes, if they fail to comply with the cease-and-desist letters, the San Francisco attorney general could pursue legal action. The case would test whether app stores are legally responsible for the harmful apps they distribute.
