Abstract:The continuous advancement of face forgery techniques has caused a series of trust crises, posing a significant menace to information security and personal privacy. In response, deep learning is being employed to develop effective detection methods to identify deepfake images and videos. Currently, most detection methods generally achieve satisfactory performance in intra-domain detection. However, their effectiveness remains uncertain when detecting unknown forgeries and cross-domain scenarios. From a causal learning perspective, our analysis reveals that the failure of detectors in cross-domain detection primarily arises from spurious correlations between irrelevant features and category labels (real and fake). In this study, we propose the Feature Independence Constrainer (FIC) to alleviate spurious correlations and enhance the generalization for detection method. Specifically, FIC maps features to a Reproducing Kernel Hilbert Space and calculates the covariance matrix among the kernel-mapped features. Dynamic weight parameters are incorporated into the covariance matrix for iterative optimization. Consequently, statistical correlations between features are eliminated, ensuring independence between each pair of features and mitigating the impact of spurious correlations. Additionally, we introduce fine-grained high-frequency components to force the detection model to learn comprehensive forgery-related artifacts while avoiding spurious correlations between irrelevant features and labels. Furthermore, a Feature Alignment Module (FAM) is designed to explore higher-order dependencies between the spatial and frequency domains, allowing for the extraction of richer potential forgery traces. Quantitative and qualitative experiments demonstrate that the proposed method achieves competitive performance across multiple face forgery benchmark datasets, outperforming state-of-the-art methods.

Fine-grained Face Verification: FGLFW Database, Baselines, and Human-Dcmn Partnership.

Fine-grained LFW Database.

Face Anti-Spoofing with Human Material Perception

Face Verification Based on Deep Bayesian Convolutional Neural Network in Unconstrained Environment

Face Verification with Multi-Task and Multi-Scale Feature Fusion

Towards Generalizable Face Forgery Detection Via Mitigating Spurious Correlation

The Devil is in the Detail: Deep Feature Based Disguised Face Recognition Method

Deep Representation for Partially Occluded Face Verification

Fine-grained face verification: Dataset and baseline results

Face Forgery Detection Via Multi-Feature Fusion and Local Enhancement

Exploiting Facial Relationships and Feature Aggregation for Multi-Face Forgery Detection

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

FPC‐Net: Learning to Detect Face Forgery by Adaptive Feature Fusion of Patch Correlation with CG‐Loss

Detection of Deepfake Videos Using Long-Distance Attention

Exploring Disentangled Content Information for Face Forgery Detection

Face Forensics in the Wild

Towards General Visual-Linguistic Face Forgery Detection.

Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection

Learning to Detect Deepfakes via Adaptive Attention and Constrained Difference.

Learning prototype hyperplanes for face verification in the wild.

FFR_FD: Effective and fast detection of DeepFakes via feature point defects