Abstract:The continuous advancement of face forgery techniques has caused a series of trust crises, posing a significant menace to information security and personal privacy. In response, deep learning is being employed to develop effective detection methods to identify deepfake images and videos. Currently, most detection methods generally achieve satisfactory performance in intra-domain detection. However, their effectiveness remains uncertain when detecting unknown forgeries and cross-domain scenarios. From a causal learning perspective, our analysis reveals that the failure of detectors in cross-domain detection primarily arises from spurious correlations between irrelevant features and category labels (real and fake). In this study, we propose the Feature Independence Constrainer (FIC) to alleviate spurious correlations and enhance the generalization for detection method. Specifically, FIC maps features to a Reproducing Kernel Hilbert Space and calculates the covariance matrix among the kernel-mapped features. Dynamic weight parameters are incorporated into the covariance matrix for iterative optimization. Consequently, statistical correlations between features are eliminated, ensuring independence between each pair of features and mitigating the impact of spurious correlations. Additionally, we introduce fine-grained high-frequency components to force the detection model to learn comprehensive forgery-related artifacts while avoiding spurious correlations between irrelevant features and labels. Furthermore, a Feature Alignment Module (FAM) is designed to explore higher-order dependencies between the spatial and frequency domains, allowing for the extraction of richer potential forgery traces. Quantitative and qualitative experiments demonstrate that the proposed method achieves competitive performance across multiple face forgery benchmark datasets, outperforming state-of-the-art methods.

Discover and Cure: Concept-aware Mitigation of Spurious Correlation

Learning and Exploiting Interclass Visual Correlations for Medical Image Classification

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

Learning Robust Classifiers with Self-Guided Spurious Correlation Mitigation

Towards Mitigating more Challenging Spurious Correlations: A Benchmark & New Datasets

Unsupervised Concept Discovery Mitigates Spurious Correlations

Debiasing Counterfactuals In the Presence of Spurious Correlations

Reducing Spurious Correlation for Federated Domain Generalization

Reducing Spurious Correlations for Answer Selection by Feature Decorrelation and Language Debiasing.

SLIM: Spuriousness Mitigation with Minimal Human Annotations

Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis

Right for the Wrong Reason: Can Interpretable ML Techniques Detect Spurious Correlations?

Mitigating Spurious Correlations for Self-supervised Recommendation

On the Impact of Spurious Correlation for Out-of-Distribution Detection

Out of spuriousity: Improving robustness to spurious correlations without group annotations

Spurious Features Everywhere -- Large-Scale Detection of Harmful Spurious Features in ImageNet

Mitigating Backdoor Poisoning Attacks through the Lens of Spurious Correlation

Towards Generalizable Face Forgery Detection Via Mitigating Spurious Correlation

DISCO: DISCovering Overfittings as Causal Rules for Text Classification Models

Robustness to Spurious Correlations via Human Annotations

Spuriousness-Aware Meta-Learning for Learning Robust Classifiers