Meta's ad platform displayed AI tool promos that could nude female US politicians

Meta ran advertisements for the Kromix AI app, which lets users generate deepfake porn of women, including a likeness of a prominent female US politician, despite the company's anti-sexual-content rules.

Meta's advertising system displayed a series of video promos for Kromix, an AI-driven app that enables users to create nonconsensual pornographic videos of real people, including a figure who closely mirrors a leading female US politician. The ads, aimed solely at male audiences, carried the slogan "Unleash Next-gen AI Magic" and were live for periods ranging from five to 46 hours before being taken down following one outlet inquiry.

Kromix advertised "no restrictions" and allowed paid users to place uploaded faces into scenarios like "bedroom rape" and "Disney love," with some videos featuring AI-generated porn of women in Spider-Man costumes. Apple removed the app after it added prohibited content post-review, and San Francisco's city attorney has previously issued cease-and-desist letters to similar services. Meta says its ad-review process relies heavily on automated tools, but acknowledges that bad actors use deceptive cover images to evade detection, prompting the company to launch new AI defenses and pursue legal action against developers. Researchers from the Tech Transparency Project and the American Sunlight Project highlighted the broader trend of deepfake abuse targeting female politicians worldwide.