Abstract:The widespread dissemination of high-fidelity fake faces created by face forgery techniques has caused serious trust concerns and ethical issues in modern society. Consequently, face forgery detection has emerged as a prominent topic of research to prevent technology abuse. Although, most existing face forgery detectors demonstrate success when evaluating high-quality faces under intra-dataset scenarios, they often overfit manipulation-specific artifacts and lack robustness to postprocessing operations. In this work, we design an innovative dual-branch collaboration framework that leverages the strengths of the transformer and CNN to thoroughly dig into the multimodal forgery artifacts from both a global and local perspective. Specifically, a novel adaptive noise trace enhancement module (ANTEM) is proposed to remove high-level face content while amplifying more generalized forgery artifacts in the noise domain. Then, the transformer-based branch can track long-range noise features. Meanwhile, considering that subtle forgery artifacts could be described in the frequency domain even in a compression scenario, a multilevel frequency-aware module (MFAM) is developed and further applied to the CNN-based branch to extract complementary frequency-aware clues. Besides, we incorporate a collaboration strategy involving cross-entropy loss and single center loss to enhance the learning of more generalized representations by optimizing the fusion features of the dual branch. Extensive experiments on various benchmark datasets substantiate the superior generalization and robustness of our framework when compared to the competing approaches.

Detection of AI-Manipulated Fake Faces via Mining Generalized Features

Mining Generalized Features for Detecting AI-Manipulated Fake Faces

Semantic and Frequency Representation Mining for Face Manipulation Detection

Mining Generalized Multi-timescale Inconsistency for Detecting Deepfake Videos

Face Anti-Spoofing Via Jointly Modeling Local Texture and Constructed Depth

Fake face detection via adaptive manipulation traces extraction network

TAN-GFD: Generalizing Face Forgery Detection Based on Texture Information and Adaptive Noise Mining

Learning Forgery Region-Aware and ID-Independent Features for Face Manipulation Detection

Multiple Feature Mining Based on Local Correlation and Frequency Information for Face Forgery Detection

Towards the Detection of AI-Synthesized Human Face Images

Detecting facial manipulated images via one-class domain generalization

A Two-Stage Fake Face Image Detection Algorithm with Expanded Attention

Face Manipulation Detection Via Auxiliary Supervision

FFR_FD: Effective and fast detection of DeepFakes via feature point defects

Manipulation-Invariant Fingerprints for Cross-Dataset Deepfake Detection.

Exploiting Facial Relationships and Feature Aggregation for Multi-Face Forgery Detection

Using Grayscale Frequency Statistic to Detect Manipulated Faces in Wavelet-Domain.

Multi-feature fusion based face forgery detection with local and global characteristics

Face Manipulation Detection Based on Supervised Multi-Feature Fusion Attention Network

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

Towards Generalizable and Robust Face Manipulation Detection Via Bag-of-feature