Abstract:The challenge of generalization in face forgery detection has become increasingly prominent as manipulation techniques continue to evolve. Although recent image blending-based methods have demonstrated remarkable potential, they often encounter a significant performance drop when applied to datasets exhibiting significant domain gaps. This limitation stems from the exclusive reliance of prior methods on blending unaltered faces with various augmentations to produce common artifacts, which ignores the inherent characteristics of the forged regions. To fully exploit the potential of image blending-based methods for generalizable Deepfake detection, we propose a novel image synthesis framework called Bi-Level Inconsistency Generator (Bi-LIG) to introduce bi-level inconsistency in the synthesized images. Specifically, Bi-LIG generates synthetic images by blending source and target images from both pristine and forged image sets, introducing a) Extrinsic-Inconsistency between real and pseudo-forged regions, and b) Inherent-Inconsistency between real and manipulated areas. In this way, Bi-LIG creates a diverse synthesized image set and establishes a generalizable training domain. Furthermore, we propose a novel face forgery detection network named Token Consistency Constrained Vision Transformer, in which two modules are developed based on patch consistency learning. Firstly, a Patch Token Contrast module is employed to learn the bi-level patch inconsistencies. Secondly, a Progressive Patch Token Assemble module is adopted to aggregate local patch relations and enhance the inconsistency representations. Experimental results demonstrate the effectiveness and superiority of our method on both in-dataset and cross-dataset evaluations. Notably, our approach outperforms state-of-the-art methods by 5.09% and 10.15% on cross-dataset evaluations in DFDCp and DFDC, respectively.

Discrepancy-Guided Reconstruction Learning for Image Forgery Detection

AGIL-SwinT: Attention-guided Inconsistency Learning for Face Forgery Detection

Exploring Disentangled Content Information for Face Forgery Detection

End-to-End Reconstruction-Classification Learning for Face Forgery Detection

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Dual Contrastive Learning for General Face Forgery Detection.

Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection

Face Reconstruction-Based Generalized Deepfake Detection Model with Residual Outlook Attention

Feature enhancement and supervised contrastive learning for image splicing forgery detection

Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning

Exploring Bi-Level Inconsistency Via Blended Images for Generalizable Face Forgery Detection

Forgery Face Detection Via Adaptive Learning from Multiple Experts

Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation

Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection

Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detection

Multi-level feature disentanglement network for cross-dataset face forgery detection

Learning to Discover Forgery Cues for Face Forgery Detection

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

Deep Visual Identity Forgery and Detection

Detection of image recognition forgery technology under machine vision