Abstract:With the continuous development of deep counterfeiting technology, the information security in our daily life is under serious threat. While existing face forgery detection methods exhibit impressive accuracy when applied to datasets such as FaceForensics++ and Celeb- DF, they falter significantly when confronted with out-of-domain scenarios. This causes specialization of learned representations to known forgery patterns presented in the training set, rendering it difficult to detect forgeries with unknown patterns. To address this challenge, we propose a novel end-to-end Face Reconstruction-based Generalized Deepfake Detection model with Residual Outlook Attention, named FRG2D, which emphasizes the robust visual representations of genuine faces and discerns the subtle differences between authentic and manipulated facial images. Our methodology entails reconstructing authentic face images using an encoder-decoder architecture based on U-net, facilitating a deeper understanding of disparities between genuine and manipulated facial images. Furthermore, we integrate the convolutional block attention module (CBAM) and channel attention block (CAB) to selectively focus the network’s attention on salient features within real face images. Furthermore, we employ Residual Outlook Attention (ROA) to guide the network’s focus towards precise features within manipulated facial images. Simultaneously, the computed reconstruction differences obtained through Residual Outlook Attention serves as the ultimate representation fed into the classifier for face forgery detection. Both the reconstruction and classification learning processes are optimized end-to-end. Through extensive experimentation, our model demonstrated a substantial improvement in deepfake detection across unknown domains, while maintaining a high accuracy within the known domain.

Learning to Detect Deepfakes via Adaptive Attention and Constrained Difference.

FPC‐Net: Learning to Detect Face Forgery by Adaptive Feature Fusion of Patch Correlation with CG‐Loss

Detection of Deepfake Videos Using Long-Distance Attention

Forgery-Domain-Supervised Deepfake Detection with Non-Negative Constraint.

Face Forgery Detection Based on Multi-Scale Anchor and Frame Fusion

Attention Consistency Refined Masked Frequency Forgery Representation for Generalizing Face Forgery Detection

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

Temporal Consistency Based Deep Face Forgery Detection Network.

Attention-guided Fine-grained Feature Learning For Robust Face Forgery Detection

Adaptive Face Forgery Detection in Cross Domain.

Exploring Frequency Attention Learning and Contrastive Learning for Face Forgery Detection.

MC-LCR: Multimodal contrastive classification by locally correlated representations for effective face forgery detection

Face Forgery Detection with Long-Range Noise Features and Multilevel Frequency-Aware Clues

MTD-Net: Learning to Detect Deepfakes Images by Multi-Scale Texture Difference

Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localization

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

Dynamic Difference Learning with Spatio-temporal Correlation for Deepfake Video Detection

Face Forgery Detection Based on Fine-grained Clues and Noise Inconsistency

Multi-attentional Deepfake Detection

Face Reconstruction-Based Generalized Deepfake Detection Model with Residual Outlook Attention