Abstract:The proliferation of fake images generated by deepfake techniques has significantly threatened the trustworthiness of digital information, leading to a pressing need for face forgery detection. However, due to the similarity between human face images and the subtlety of artefact information, most deep face forgery detection methods face certain challenges, such as incomplete extraction of artefact information, limited performance in detecting low-quality forgeries, and insufficient generalization across different datasets. To address these issues, this paper proposes a novel noise-aware multi-scale deepfake detection model. Firstly, a progressive spatial attention module is introduced, which learns two types of spatial feature weights: boosting weight and suppression weight. The boosting weight highlights salient regions, while the suppression weight enables the model to capture more subtle artifact information. Through multiple boosting-suppression stages, the proposed model progressively focuses on different facial regions and extracts multi-scale RGB features. Additionally, a noise-aware two-stream network is introduced, which leverages frequency-domain features and fuses image noise with multi-scale RGB features. This integration enhances the model's ability to handle image post-processing. Furthermore, the model learns global features from multi-modal features through multiple convolutional layers, which are combined with local similarity features for deepfake detection, thereby improving the model's robustness. Experimental results on several benchmark databases demonstrate the superiority of our proposed method over state-of-the-art techniques. Our contributions lie in the progressive spatial attention module, which effectively addresses overfitting in CNNs, and the integration of noise-aware features and multi-scale RGB features. These innovations lead to enhanced accuracy and generalization performance in face forgery detection.

Dor: Detecting Deepfake Videos Using the Dissonance Between Intra- and Inter-Frame Maps

Video Forgery Detection Using Spatio-Temporal Dual Transformer.

FFR_FD: Effective and Fast Detection of DeepFakes Based on Feature Point Defects

Forgery Detection by Weighted Complementarity Between Significant Invariance and Detail Enhancement

FInfer: Frame Inference-Based Deepfake Detection for High-Visual-Quality Videos

Detection of Deepfake Videos Using Long-Distance Attention

Dual-Modality Co-Learning for Unveiling Deepfake in Spatio-Temporal Space.

Coherent Adversarial Deepfake Video Generation

Double-Stream Segmentation Network with Temporal Self-attention for Deepfake Video Detection

Deepfake Detection Via Inter-Frame Inconsistency Recomposition and Enhancement

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

Noise-aware progressive multi-scale deepfake detection

Exposing Deepfake Videos with Spatial, Frequency and Multi-scale Temporal Artifacts

Exploiting Complementary Dynamic Incoherence for DeepFake Video Detection

Video Detection Method Based on Temporal and Spatial Foundations for Accurate Verification of Authenticity

Exploring varying color spaces through representative forgery learning to improve deepfake detection

DFCP: Few-Shot DeepFake Detection via Contrastive Pretraining

Multi-feature fusion based face forgery detection with local and global characteristics

DeepFake Detection Based on High-Frequency Enhancement Network for Highly Compressed Content

Interactive Two-Stream Network Across Modalities for Deepfake Detection

Combating deepfakes: a comprehensive multilayer deepfake video detection framework