Abstract:The rapid advancement of deep learning and large-scale AI models has simplified the creation and manipulation of deepfake technologies, which generate, edit, and replace faces in images and videos. This gradual ease of use has turned the malicious application of forged faces into a significant threat, complicating the task of deepfake detection. Despite the notable success of current deepfake detection methods, which predominantly employ data-driven CNN classification models, these methods exhibit limited generalization capabilities and insufficient robustness against novel data unseen during training. To tackle these challenges, this paper introduces a novel detection framework, ReLAF-Net. This framework employs a restricted self-attention mechanism that applies self-attention to deep CNN features flexibly, facilitating the learning of local relationships and inter-regional dependencies at both fine-grained and global levels. This attention mechanism has a modular design that can be seamlessly integrated into CNN networks to improve overall detection performance. Additionally, we propose an adaptive local frequency feature extraction algorithm that decomposes RGB images into fine-grained frequency domains in a data-driven manner, effectively isolating fake indicators in the frequency space. Moreover, an attention-based channel fusion strategy is developed to amalgamate RGB and frequency information, achieving a comprehensive facial representation. Tested on the high-quality version of the FaceForensics++ dataset, our method attained a detection accuracy of 97.92%, outperforming other approaches. Cross-dataset validation on Celeb-DF, DFDC, and DFD confirms the robust generalizability, offering a new solution for detecting high-quality deepfake videos.

Where to Focus: Central Attention-Based Face Forgery Detection.

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Thinking in Frequency: Face Forgery Detection by Mining Frequency-Aware Clues

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face forgery detection by progressively enhancing spatial and frequency-aware features

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

Combined spatial and frequency dual stream network for face forgery detection

Dual-Cross Central Difference Network for Face Anti-Spoofing.

Generalizing Face Forgery Detection with High-frequency Features

Face Anti-Spoofing with Human Material Perception

Semantic and Frequency Representation Mining for Face Manipulation Detection

FLAG: frequency-based local and global network for face forgery detection

Coarse-to-fine spatial-channel-boundary attention network for image copy-move forgery detection

Exploring Disentangled Content Information for Face Forgery Detection

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection

Searching Central Difference Convolutional Networks for Face Anti-Spoofing

Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain