Abstract:Deepfake technique can synthesize realistic images, audios, and videos, facilitating the thriving of entertainment, education, healthcare, and other industries. However, its abuse may pose potential threats to personal privacy, social stability, and even national security. Therefore, the development of deepfake detection methods is attracting more and more attention. Existing works mainly focus on the detection of common videos for entertainment purposes. In contrast, fake videos maliciously synthesized for Person of Interest (PoI, i.e., who is in an authoritative position and has broadly public influences) are much more harmful to society because of celebrity endorsement. However, there is no particular benchmark for driving related research in the community. Motivated by this observation, we present the first large-scale benchmark dataset, named FakePoI, to enable the research on fake PoI detection. It contains numerous fake videos of important people from all walks of life, e.g., police chiefs, city mayors, famous artists, and well-known Internet bloggers. In summary, our FakePoI includes 11092 synthesized videos where only a few clips rather than the entire are fake. Previous fake detection algorithms deteriorate heavily or even fail on our FakePoI due to two main challenges. On the one hand, the rich diversity of our fake videos makes it pretty difficult to find universally applicable patterns for detection. On the other hand, the high credibility contributed by the presence of real frames easily confuses a common detector. To tackle these challenges, we present an amplifier framework, highlighting the feature gap between real and generated video frames. Specifically, we present a quadruplet loss to narrow the distance of all real PoIs and meanwhile push away each real and fake PoI in embedding space. We implement our framework and conduct extensive experiments on the proposed benchmark. The quantitative results demonstrate that our approach outperforms existing methods significantly, setting a strong baseline on FakePoI. The qualitative analysis also shows its superiority. We will release our dataset and code at https://github.com/cslltian/deepfake-detection to encourage future research on this valuable area.

Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics

FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset

A Large-scale Universal Evaluation Benchmark For Face Forgery Detection

eKYC-DF: A Large-Scale Deepfake Dataset for Developing and Evaluating eKYC Systems

Deepfake Videos in the Wild: Analysis and Detection

WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection

Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Models

Towards Understanding of Deepfake Videos in the Wild

Video Detection Method Based on Temporal and Spatial Foundations for Accurate Verification of Authenticity

Unmasking DeepFakes with simple Features

DeepFake detection method based on multi-scale interactive dual-stream network

CelebA-Spoof: Large-Scale Face Anti-spoofing Dataset with Rich Annotations

The Face Deepfake Detection Challenge

GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning

FakePoI: A Large-Scale Fake Person of Interest Video Detection Benchmark and a Strong Baseline

KoDF: A Large-scale Korean DeepFake Detection Dataset

A Contemporary Survey on Deepfake Detection: Datasets, Algorithms, and Challenges

A Survey on Deepfake Video Detection

Identity-Driven DeepFake Detection

Exposing Deepfake Using Fusion of Deep-Learned and Hand-Crafted Features