Abstract:The continuous advancement of face forgery techniques has caused a series of trust crises, posing a significant menace to information security and personal privacy. In response, deep learning is being employed to develop effective detection methods to identify deepfake images and videos. Currently, most detection methods generally achieve satisfactory performance in intra-domain detection. However, their effectiveness remains uncertain when detecting unknown forgeries and cross-domain scenarios. From a causal learning perspective, our analysis reveals that the failure of detectors in cross-domain detection primarily arises from spurious correlations between irrelevant features and category labels (real and fake). In this study, we propose the Feature Independence Constrainer (FIC) to alleviate spurious correlations and enhance the generalization for detection method. Specifically, FIC maps features to a Reproducing Kernel Hilbert Space and calculates the covariance matrix among the kernel-mapped features. Dynamic weight parameters are incorporated into the covariance matrix for iterative optimization. Consequently, statistical correlations between features are eliminated, ensuring independence between each pair of features and mitigating the impact of spurious correlations. Additionally, we introduce fine-grained high-frequency components to force the detection model to learn comprehensive forgery-related artifacts while avoiding spurious correlations between irrelevant features and labels. Furthermore, a Feature Alignment Module (FAM) is designed to explore higher-order dependencies between the spatial and frequency domains, allowing for the extraction of richer potential forgery traces. Quantitative and qualitative experiments demonstrate that the proposed method achieves competitive performance across multiple face forgery benchmark datasets, outperforming state-of-the-art methods.

Exploring Disentangled Content Information for Face Forgery Detection

Multi-level feature disentanglement network for cross-dataset face forgery detection

Towards Generalizable Face Forgery Detection Via Mitigating Spurious Correlation

Learning Dual Aggregate Features for Face Forgery Detection

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

Face Forgery Detection Via Multi-Feature Fusion and Local Enhancement

Dual Contrastive Learning for General Face Forgery Detection.

Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection

Face Forgery Detection Based on Fine-grained Clues and Noise Inconsistency

Temporal Consistency Based Deep Face Forgery Detection Network.

Learning Forgery Region-Aware and ID-Independent Features for Face Manipulation Detection

Face forgery detection by progressively enhancing spatial and frequency-aware features

TAN-GFD: Generalizing Face Forgery Detection Based on Texture Information and Adaptive Noise Mining

Exploring Bi-Level Inconsistency Via Blended Images for Generalizable Face Forgery Detection

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Ldsfnet: lightweight dynamic selection fusion network for face forgery detection

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

MC-LCR: Multimodal contrastive classification by locally correlated representations for effective face forgery detection

LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection