Abstract:Face forgery detection has attracted much attention due to the ever-increasing social concerns caused by facial manipulation techniques. Recently, identity-based detection methods have made considerable progress, which is especially suitable in the celebrity protection scenario. However, they still suffer from two main limitations: (a) generic identity extractor is not specifically designed for forgery detection, leading to nonnegligible Identity Representation Bias to forged images. (b) existing methods only analyze the identity representation of each image individually, but ignores the query-reference interaction for inconsistency exploiting. To address these issues, a novel Inconsistency Exploiting based Identity Rectification Network (IEIRNet) is proposed in this paper. Firstly, for the identity bias rectification, the IEIRNet follows an effective two-branches structure. Besides the Generic Identity Extractor (GIE) branch, an essential Bias Diminishing Module (BDM) branch is proposed to eliminate the identity bias through a novel Attention-based Bias Rectification (ABR) component, accordingly acquiring the ultimate discriminative identity representation. Secondly, for query-reference inconsistency exploiting, an Inconsistency Exploiting Module (IEM) is applied in IEIRNet to comprehensively exploit the inconsistency clues from both spatial and channel perspectives. In the spatial aspect, an innovative region-aware kernel is derived to activate the local region inconsistency with deep spatial interaction. Afterward in the channel aspect, a co-attention mechanism is utilized to model the channel interaction meticulously, and accordingly highlight the channel- wise inconsistency with adaptive weight assignment and channel- wise dropout. Our IEIRNet has shown effectiveness and superiority in various generalization and robustness experiments. Specifically, in the challenging DFDCp dataset, IEIRNet achieves the 12.1% and 7.3% advantages compared with binary-based and identity-based methods respectively.

IPFR: Identity-Preserving Face Reenactment with Enhanced Domain Adversarial Training and Multi-level Identity Priors.

FReeNet: Multi-Identity Face Reenactment

FaceSwapNet: Landmark Guided Many-to-Many Face Reenactment

Real-Time Audio-Guided Multi-Face Reenactment

APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment

Designing One Unified Framework for High-Fidelity Face Reenactment and Swapping

Learning a High Fidelity Identity Representation for Face Frontalization

LI-Net: Large-Pose Identity-Preserving Face Reenactment Network

IFaceUV: Intuitive Motion Facial Image Generation by Identity Preservation via UV map

Transferable Adversarial Facial Images for Privacy Protection

Maskrenderer: 3D-infused multi-mask realistic face reenactment

Transferable Facial Privacy Protection Against Blind Face Restoration Via Domain-Consistent Adversarial Obfuscation

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

Identity-preserving Face Recovery from Portraits

Towards Open-Set Identity Preserving Face Synthesis

Identity-Preserving Face Hallucination via Deep Reinforcement Learning

RAIRNet: Region-Aware Identity Rectification for Face Forgery Detection

ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification

IdentityDP: Differential Private Identification Protection for Face Images

Identity-Preserving Face Swapping via Dual Surrogate Generative Models

IEIRNet: Inconsistency Exploiting Based Identity Rectification for Face Forgery Detection