Characterizing the MrDeepFakes Sexual Deepfake Marketplace

Catherine Han,Anne Li,Deepak Kumar,Zakir Durumeric
DOI: https://doi.org/10.48550/arXiv.2410.11100
2024-10-15
Abstract:The prevalence of sexual deepfake material has exploded over the past several years. Attackers create and utilize deepfakes for many reasons: to seek sexual gratification, to harass and humiliate targets, or to exert power over an intimate partner. In tandem with this growth, several markets have emerged to support the buying and selling of sexual deepfake material. In this paper, we systematically characterize the most prominent and mainstream marketplace, MrDeepFakes. We analyze the marketplace economics, the targets of created media, and user discussions of how to create deepfakes, which we use to understand the current state-of-the-art in deepfake creation. Our work uncovers little enforcement of posted rules (e.g., limiting targeting to well-established celebrities), previously undocumented attacker motivations, and unexplored attacker tactics for acquiring resources to create sexual deepfakes.
Computers and Society,Cryptography and Security,Human-Computer Interaction,Social and Information Networks
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the proliferation of sexual deepfake content on the Internet and the social harm it brings. Specifically, the researchers focus on the following aspects: 1. **Market Dynamics and Economic Analysis**: The paper systematically describes the operating mechanism of the most mainstream sexual deepfake market platform, MrDeepFakes, including the interactions among buyers, sellers, and the objects being forged. By analyzing forum discussions, the researchers reveal the current state of deepfake technology and explore the motives and technical challenges behind it. 2. **Analysis of Target Population**: The paper analyzes the objects being forged (mainly female celebrities and public figures) and points out that although the platform claims to target only well - known individuals, in fact, many of the objects being forged do not have extensive public influence or social media presence. In addition, there are also rule - violating contents on the platform, such as videos involving rape, abuse and other scenarios. 3. **Buyer Motivations**: Through a detailed analysis of 830 paid requests, the researchers have discovered the main motivations of buyers, including involuntary sexual satisfaction, the display of power and masculinity, and the sense of contribution to the community. These motivations go beyond the traditional understanding of image - based sexual abuse (IBSA) actors. 4. **Technical Challenges and Support**: The paper also explores the technical difficulties in creating deepfake content, such as obtaining facial image data, software proficiency, and hardware requirements. The study finds that the MrDeepFakes community relies on open - source software and free cloud GPU resources (such as Google Colab notebooks) to support creators. 5. **Policy Recommendations**: Finally, the paper puts forward policy recommendations for this problem, calling on researchers, industry participants, and policymakers to work together to address the threats posed by the abuse of deepfakes. In summary, this paper aims to comprehensively reveal the current situation, operating mechanism, and social impact of the sexual deepfake market and provide suggestions for relevant parties to improve the situation.