Abstract:Face forgery detection has attracted much attention due to the ever-increasing social concerns caused by facial manipulation techniques. Recently, identity-based detection methods have made considerable progress, which is especially suitable in the celebrity protection scenario. However, they still suffer from two main limitations: (a) generic identity extractor is not specifically designed for forgery detection, leading to nonnegligible Identity Representation Bias to forged images. (b) existing methods only analyze the identity representation of each image individually, but ignores the query-reference interaction for inconsistency exploiting. To address these issues, a novel Inconsistency Exploiting based Identity Rectification Network (IEIRNet) is proposed in this paper. Firstly, for the identity bias rectification, the IEIRNet follows an effective two-branches structure. Besides the Generic Identity Extractor (GIE) branch, an essential Bias Diminishing Module (BDM) branch is proposed to eliminate the identity bias through a novel Attention-based Bias Rectification (ABR) component, accordingly acquiring the ultimate discriminative identity representation. Secondly, for query-reference inconsistency exploiting, an Inconsistency Exploiting Module (IEM) is applied in IEIRNet to comprehensively exploit the inconsistency clues from both spatial and channel perspectives. In the spatial aspect, an innovative region-aware kernel is derived to activate the local region inconsistency with deep spatial interaction. Afterward in the channel aspect, a co-attention mechanism is utilized to model the channel interaction meticulously, and accordingly highlight the channel- wise inconsistency with adaptive weight assignment and channel- wise dropout. Our IEIRNet has shown effectiveness and superiority in various generalization and robustness experiments. Specifically, in the challenging DFDCp dataset, IEIRNet achieves the 12.1% and 7.3% advantages compared with binary-based and identity-based methods respectively.

IEIRNet: Inconsistency Exploiting Based Identity Rectification for Face Forgery Detection

RAIRNet: Region-Aware Identity Rectification for Face Forgery Detection

STIDNet: Identity-Aware Face Forgery Detection with Spatiotemporal Knowledge Distillation

Exploring Bi-Level Inconsistency Via Blended Images for Generalizable Face Forgery Detection

Learning Forgery Region-Aware and ID-Independent Features for Face Manipulation Detection

Learning Domain-Invariant Representation for Generalizing Face Forgery Detection.

Exploring Disentangled Content Information for Face Forgery Detection

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Identity-Enhanced Network for Facial Expression Recognition

Towards Generalizable Face Forgery Detection Via Mitigating Spurious Correlation

IPFR: Identity-Preserving Face Reenactment with Enhanced Domain Adversarial Training and Multi-level Identity Priors.

BENet: A Cross-domain Robust Network for Detecting Face Forgeries via Bias Expansion and Latent-space Attention

Inspector for Face Forgery Detection: Defending Against Adversarial Attacks From Coarse to Fine

Fine-grained Learning for Visible-Infrared Person Re-identification

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection

PRRNet: Pixel-Region relation network for face forgery detection

Inter-class Discrepancy Alignment for Face Recognition

LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection

ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification