Friday, November 20, 2026
SearchAdmin

The Intelligent Ledger

AI-Curated Financial Intelligence

Back to headlines

Tech Giants Failing to Stop Nonconsensual Deepfakes on Hugging Face

|Original source
Tech Giants Failing to Stop Nonconsensual Deepfakes on Hugging Face

+AI Analysis - Key Points

  • 01

    US law enforcement seizes deepfake hosting websites

  • 02

    EU and UK plan to ban 'nudify' apps by the end of the year

  • 03

    Hugging Face's image editing Spaces easily create nonconsensual deepfakes

The crackdown on harmful sexual deepfakes is slowly taking hold, with US law enforcement officials seizing deepfake hosting websites and the EU and UK drawing up plans to ban 'nudify' apps by the end of the year. However, large tech companies are still pushing millions in the direction of software that can digitally undress people without their consent. A new report published by the European nonprofit AI Forensics reveals a widespread problem with nonconsensual deepfakes on the open-source AI platform Hugging Face.

Hugging Face—a repository of AI models and datasets valued in the billions—has a significant issue with nonconsensual deepfakes, according to the report. Researchers from AI Forensics tested nine of the top image editing Spaces on Hugging Face and found that seven of these easily changed a clothed image of a woman into a topless one. In further testing, AI Forensics researchers created their own honey-pot-style image editing Spaces on Hugging Face and tracked more than 1,000 prompts and images they received over a week. In total, AI Forensics says, 73 percent of the prompts they received were sexual in nature.

Article illustration
Related coverage

The research also reveals that 83 percent of the sexual requests targeted women, with 95 percent of these being women. Additionally, 6.7 percent of the sexual requests targeted apparent children. The lead researcher at AI Forensics, Paul Bouchaud, says that most of the Spaces tested can be used for generating nonconsensual intimate images, and users are actually using it for these purposes. This is not an empty threat, but actually people are using Hugging Face for that.

An additional review of materials on Hugging Face's website, plus findings from other researchers, also shows multiple pages promoting nudifying technologies or AI models that could potentially create sexualized images of named celebrities and politicians. Hugging Face did not respond to numerous questions from WIRED about its content moderation mechanisms and safety practices. The company has content policies that prohibit child sexual abuse material and sexual deepfakes that are created 'without explicit consent' or are used for harassment or bullying. Some pages promoting nudifying services were removed after WIRED contacted the company; however, it is unclear if the two are related.

The issue of nonconsensual deepfakes is a growing concern, and it is clear that more needs to be done to address it. Tech companies must take responsibility for the content that is being hosted on their platforms and ensure that they have adequate content moderation mechanisms in place. The public also needs to be aware of the risks associated with nonconsensual deepfakes and take steps to protect themselves.

The crackdown on harmful sexual deepfakes is a complex issue that requires a multifaceted approach. It is not just a matter of banning certain technologies or apps, but also of educating the public and holding tech companies accountable for their role in perpetuating this issue. By working together, we can create a safer and more responsible online environment.

The issue of nonconsensual deepfakes is a growing concern, and it is clear that more needs to be done to address it. Tech companies must take responsibility for the content that is being hosted on their platforms and ensure that they have adequate content moderation mechanisms in place. The public also needs to be aware of the risks associated with nonconsensual deepfakes and take steps to protect themselves.

The crackdown on harmful sexual deepfakes is a complex issue that requires a multifaceted approach. It is not just a matter of banning certain technologies or apps, but also of educating the public and holding tech companies accountable for their role in perpetuating this issue. By working together, we can create a safer and more responsible online environment.

VideoVideo Coverage

Tech Giants Failing to Stop Nonconsensual Deepfakes on Hugging Face

Watch video coverage on YouTube

Opens relevant video results on YouTube.