
AI Regulation · Content Moderation · Deepfake Lawsuit · Tech Liability
The San Francisco City Attorney initiated a landmark lawsuit against 16 "nudify" websites, accusing them of violating United States laws concerning non-consensual intimate images and child abuse material, following over 200 million visits to these sites in the first half of 2024.
These platforms utilize AI to generate fake, photorealistic explicit images from uploaded photos within seconds. Advertising for such apps increased by 2,400% on social media since the start of the year.
Deepfake abuse causes significant harm, including reputational damage and severe mental health effects for victims. Digital platforms like Meta and Apple have implemented policies and removed apps from their stores, while Google announced measures to reduce search visibility for reported content.
Governments, including Australia, are introducing new laws and regulatory frameworks; a proposed bill in Australia creates a standalone offense for non-consensual sharing of private sexual material, carrying a maximum six-year prison sentence. The article emphasizes the critical need for improved digital literacy and accountability across perpetrators, tech developers, and companies to combat this growing issue.