DeepFake-O-Meter v2.0: An Open Platform for DeepFake Detection

Yan Ju,Chengzhe Sun,Shan Jia,Shuwei Hou,Zhaofeng Si,Soumyya Kanti Datta,Lipeng Ke,Riky Zhou,Anita Nikolich,Siwei Lyu
2024-06-27
Abstract:Deepfakes, as AI-generated media, have increasingly threatened media integrity and personal privacy with realistic yet fake digital content. In this work, we introduce an open-source and user-friendly online platform, DeepFake-O-Meter v2.0, that integrates state-of-the-art methods for detecting Deepfake images, videos, and audio. Built upon DeepFake-O-Meter v1.0, we have made significant upgrades and improvements in platform architecture design, including user interaction, detector integration, job balancing, and security management. The platform aims to offer everyday users a convenient service for analyzing DeepFake media using multiple state-of-the-art detection algorithms. It ensures secure and private delivery of the analysis results. Furthermore, it serves as an evaluation and benchmarking platform for researchers in digital media forensics to compare the performance of multiple algorithms on the same input. We have also conducted detailed usage analysis based on the collected data to gain deeper insights into our platform's statistics. This involves analyzing two-month trends in user activity and evaluating the processing efficiency of each detector.
Cryptography and Security,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the threat posed by Deepfake media to society and personal privacy. Specifically, Deepfake technology can generate highly realistic fake images, videos and audios, which may be used to impersonate others or spread false information, thus undermining public trust and social stability. To solve this problem, the authors have developed an open - source online platform named **DeepFake - O - Meter v2.0**, aiming to integrate a variety of state - of - the - art Deepfake detection algorithms to help users analyze and identify Deepfake media. This platform not only provides a convenient service for ordinary users, but also provides a tool for researchers to evaluate and compare the performance of different detection algorithms. ### Main improvement points: 1. **Multimodal detection**: In addition to the original Deepfake video detection, the new version adds the Deepfake detection functions for images and audios. 2. **User - friendliness and computational efficiency**: The front - end and back - end architectures have been redesigned to improve user experience and computational efficiency. 3. **Scalability**: The functions of user feedback, usage data analysis, and the creation and submission of third - party Docker images have been added, enhancing the scalability and flexibility of the platform. ### Main contributions of the platform: - **Front - end design**: It provides a user - friendly interface, supports functions such as file upload, detector selection, user information input, etc., and realizes authorized data collection. - **Back - end design**: The types of detectors have been extended to cover the detection of AI - generated images and audios, and a task scheduling module has been introduced to handle multi - user and multi - task conflicts. - **Statistical analysis**: Through detailed analysis of four months' worth of user activity data, in - depth insights into the platform's usage have been obtained, including user activity trends, the processing efficiency of each detector, etc. Through these improvements, DeepFake - O - Meter v2.0 aims to provide users with a comprehensive, easy - to - use and efficient Deepfake detection tool, while promoting research and development in related fields.