Abstract:The proliferation of fake images generated by deepfake techniques has significantly threatened the trustworthiness of digital information, leading to a pressing need for face forgery detection. However, due to the similarity between human face images and the subtlety of artefact information, most deep face forgery detection methods face certain challenges, such as incomplete extraction of artefact information, limited performance in detecting low-quality forgeries, and insufficient generalization across different datasets. To address these issues, this paper proposes a novel noise-aware multi-scale deepfake detection model. Firstly, a progressive spatial attention module is introduced, which learns two types of spatial feature weights: boosting weight and suppression weight. The boosting weight highlights salient regions, while the suppression weight enables the model to capture more subtle artifact information. Through multiple boosting-suppression stages, the proposed model progressively focuses on different facial regions and extracts multi-scale RGB features. Additionally, a noise-aware two-stream network is introduced, which leverages frequency-domain features and fuses image noise with multi-scale RGB features. This integration enhances the model's ability to handle image post-processing. Furthermore, the model learns global features from multi-modal features through multiple convolutional layers, which are combined with local similarity features for deepfake detection, thereby improving the model's robustness. Experimental results on several benchmark databases demonstrate the superiority of our proposed method over state-of-the-art techniques. Our contributions lie in the progressive spatial attention module, which effectively addresses overfitting in CNNs, and the integration of noise-aware features and multi-scale RGB features. These innovations lead to enhanced accuracy and generalization performance in face forgery detection.

Multi-spectral Class Center Network for Face Manipulation Detection and Localization

Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localization

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

MC-LCR: Multimodal contrastive classification by locally correlated representations for effective face forgery detection

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Learning Forgery Region-Aware and ID-Independent Features for Face Manipulation Detection

Hierarchical Frequency-Assisted Interactive Networks for Face Manipulation Detection

Multi-modal Multi-layer Fusion Network with Average Binary Center Loss for Face Anti-spoofing

Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

Hybrid Domain Meta-Learning Network for Face Forgery Detection and Localization in Deepfakes.

DMFF-Net: Double-stream multilevel feature fusion network for image forgery localization

End-to-end Image Splicing Localization Based on Multi-Scale Features and Residual Refinement Module

MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection

Local Relation Learning for Face Forgery Detection

Face forgery detection by progressively enhancing spatial and frequency-aware features

Noise-aware progressive multi-scale deepfake detection

Hybrid Spatio-Temporal Network for Face Forgery Detection

Multi-level feature disentanglement network for cross-dataset face forgery detection