Abstract:The malicious usage of facial manipulation techniques boosts the desire of face forgery detection research. Recently, identity-based approaches have attracted much attention due to the effective observation of identity inconsistency. However, there are still several nonnegligible problems: (1) generic identity extractor is totally trained on real images, leading to enormous identity representation bias during processing forged content; (2) the identity information of forged image is hybrid and presents regional distribution, while the single global identity feature is hard to reflect this local identity inconsistency. To solve the above problems, in this paper a novel Region-Aware Identity Rectification Network (RAIRNet) is proposed to effectively rectify the identity bias and adaptively exploit the inconsistency local region. Firstly, for the identity bias problem, our RAIRNet is devised in a two-branch architecture, which consists of a Generic Identity Extractor (GIE) branch and a Bias Diminishing Module (BDM) branch. The BDM branch is designed to rectify the bias introduced by GIE branch through a prototype-based training schema. This two-branch architecture effectively promotes model to adapt to forged content while maintaining the focus on identity space. Secondly, for local identity inconsistency exploiting, a novel Meta Identity Filter Generator (MIFG) is devised in a meta-learning way to generate the region-aware filter based on identity prior. This region-aware filter can adaptively exploit the local inconsistency clues and activate the discriminative local region. Moreover, to balance the local-global information and highlight the forensic clues, an Adaptive Weight Assignment Mechanism (AWAM) is proposed to assign adaptive importance weight to two branches. Extensive experiments on various datasets show the superiority of our RAIRNet. In particular, on the challenging DFDCp dataset, our approach outperforms previous binary-based and identity-based methods by 10.3% and 5.5% respectively.

ARPIC: Personal Information Recognition of ID Card with Interference of Watermark

Human Identification by Means of Optoelectronic Reservoir Computing

An Intelligent Knowledge Extraction Framework For Recognizing Identification Information From Real-World Id Card Images

RFace: Anti-Spoofing Facial Authentication Using COTS RFID

Removing Interference and Recovering Content Imaginatively for Visible Watermark Removal

A New Approach in Automated Fingerprint Presentation Attack Detection Using Optical Coherence Tomography

A PC-Based System for Automated Iris Recognition under Open Environment

An Optical Watermarking Solution for Color Personal Identification Pictures

Data Protection in Palmprint Recognition Via Dynamic Random Invisible Watermark Embedding

Study on Personal Identification System Based on Iris Recognition

Large-Scale Printed Chinese Character Recognition for ID Cards Using Deep Learning and Few Samples Transfer Learning

HGAIQA: A Novel Hand-Geometry-Aware Image Quality Assessment Framework for Contactless Palmprint Recognition

On Physically Occluded Fake Identity Document Detection

Universal Defensive Underpainting Patch: Making Your Text Invisible to Optical Character Recognition

High-security Photoacoustic Identity Recognition by Capturing Hierarchical Vascular Structure of Finger.

RAIRNet: Region-Aware Identity Rectification for Face Forgery Detection

Design of Low-Cost Personal Identification System That Uses Combined Palm Vein and Palmprint Biometric Features.

DIP-Watermark: A Double Identity Protection Method Based on Robust Adversarial Watermark

Win-Win by Competition: Auxiliary-Free Cloth-Changing Person Re-Identification

IrisMarkNet: Iris feature watermarking embedding and extraction network for image copyright protection

An Automatic Location and Recognition Method for Bank Card Number