Abstract:The proliferation of fake images generated by deepfake techniques has significantly threatened the trustworthiness of digital information, leading to a pressing need for face forgery detection. However, due to the similarity between human face images and the subtlety of artefact information, most deep face forgery detection methods face certain challenges, such as incomplete extraction of artefact information, limited performance in detecting low-quality forgeries, and insufficient generalization across different datasets. To address these issues, this paper proposes a novel noise-aware multi-scale deepfake detection model. Firstly, a progressive spatial attention module is introduced, which learns two types of spatial feature weights: boosting weight and suppression weight. The boosting weight highlights salient regions, while the suppression weight enables the model to capture more subtle artifact information. Through multiple boosting-suppression stages, the proposed model progressively focuses on different facial regions and extracts multi-scale RGB features. Additionally, a noise-aware two-stream network is introduced, which leverages frequency-domain features and fuses image noise with multi-scale RGB features. This integration enhances the model's ability to handle image post-processing. Furthermore, the model learns global features from multi-modal features through multiple convolutional layers, which are combined with local similarity features for deepfake detection, thereby improving the model's robustness. Experimental results on several benchmark databases demonstrate the superiority of our proposed method over state-of-the-art techniques. Our contributions lie in the progressive spatial attention module, which effectively addresses overfitting in CNNs, and the integration of noise-aware features and multi-scale RGB features. These innovations lead to enhanced accuracy and generalization performance in face forgery detection.

AI-assisted deepfake detection using adaptive blind image watermarking

AVSecure: an Audio-Visual Watermarking Framework for Proactive Deepfake Detection

Facial Features Matter: a Dynamic Watermark based Proactive Deepfake Detection Approach

Robust Blind Video Watermarking with Adaptive Embedding Mechanism

Robust Identity Perceptual Watermark Against Deepfake Face Swapping

Are Watermarks Bugs for Deepfake Detectors? Rethinking Proactive Forensics

Deepfake Detection Based on the Adaptive Fusion of Spatial‐Frequency Features

Pluggable Watermarking of Deepfake Models for Deepfake Detection

A shared updatable method of content regulation for deepfake videos based on blockchain

Social Media Authentication and Combating Deepfakes using Semi-fragile Invisible Image Watermarking

Adaptive watermarking with self-mutual check parameters in deep neural networks

Video Detection Method Based on Temporal and Spatial Foundations for Accurate Verification of Authenticity

A defensive framework for deepfake detection under adversarial settings using temporal and spatial features

Adaptive Face Forgery Detection in Cross Domain.

FaceGuard: Proactive Deepfake Detection

CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes

Practical Deep Dispersed Watermarking with Synchronization and Fusion

Noise-aware progressive multi-scale deepfake detection

LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarks

An Automated and Robust Image Watermarking Scheme Based on Deep Neural Networks

Dual Defense: Adversarial, Traceable, and Invisible Robust Watermarking Against Face Swapping