California sues AI striptease website over: the crisis of rampant fake adult content

San Francisco has recently filed a comprehensive lawsuit against 18 websites and applications that use artificial intelligence technology to generate unauthorized fake pornographic images, victims include women, girls, and even minors. This case once again exposes the severity of malicious misuse of AI deepfake technology and reflects that such illegal websites have formed a large industrial ecosystem.

Shocking Scale: The Industry Behind Over 200 Million Visits

According to San Francisco’s complaint, these websites and apps that generate fake nude images had already exceeded 200 million visits in the first half of 2024, revealing the true demand scale for such services. This is not just a result of technological innovation but organized criminal groups commercially exploiting AI technology.

San Francisco District Attorney David Chiu stated during the announcement of the lawsuit, “This investigation has taken us into the darkest corners of the internet.” He emphasized that while generative AI has enormous development potential, any new technology can be misused. The key is to recognize that the spread of AI-generated nude content is not “innovation” but outright sexual abuse.

Victims’ Dilemma: Fake Photos Cause Real Harm

These AI-generated images are almost indistinguishable from real photos. Once they enter the internet, they can be used for various crimes: extortion, bullying, threats, and humiliation. From international superstar Taylor Swift to ordinary California middle school students, no one is immune.

Victims face multi-dimensional challenges. First, there is the direct psychological and emotional harm—discovering that their face has been placed on someone else’s body and circulated, an invasion of personal dignity that is hard to quantify. Second, there are economic losses and damage to reputation; once these images spread online, victims have little effective way to fully delete them. The complaint clearly states, “Victims have almost no recourse because once these images are circulated, they face significant barriers to removing them.”

These fake images belong to the so-called “Non-Consensual Intimate Images” (NCII), which spread faster and have a broader impact than traditional crimes. Victims are deprived of control and autonomy over their bodies and images, enduring long-term psychological, emotional, economic, and reputational harm.

The Darkest Corners: AI-Generated Child Pornography

Even more concerning is that some AI nude sites have begun allowing users to generate child pornography content. AI-generated Child Sexual Abuse Material (CSAM) poses unprecedented challenges for law enforcement and child protection.

Data from the Internet Watch Foundation shows that known pedophile organizations have already adopted this technology. Experts warn that AI-generated CSAM could “flood” the internet, making it harder for law enforcement to identify and protect actual victims. Because AI-generated content can be infinitely copied and transformed, it significantly increases enforcement costs and difficulties.

Researchers at Stanford University found that although major tech companies promise to prioritize child safety in AI development, these obscene images have already entered some AI datasets, creating a vicious cycle. To address this crisis, Louisiana has passed a law banning the use of AI to create CSAM, which took effect early 2024.

Legal Action: Can a $2,500 Fine Effectively Deter?

San Francisco’s lawsuit demands that these websites and apps pay a $2,500 fine for each violation and cease operations immediately. The suit also targets domain registrars, hosting providers, and payment processors, requiring them to stop offering services to organizations producing AI nude content.

This “chain-breaking” enforcement strategy aims to cut off the survival links of AI nude sites from multiple angles: no domain means no operation, no hosting means no storage, no payment channels mean no monetization. However, whether this can effectively curb the expansion of such sites still depends on coordinated global law enforcement and proactive commitments from tech companies.

This lawsuit from San Francisco represents a serious response to AI misuse, but truly solving the problem requires joint efforts from regulators, technology firms, internet platforms, and society as a whole.