Abstract:The rapid advancement of deep learning and large-scale AI models has simplified the creation and manipulation of deepfake technologies, which generate, edit, and replace faces in images and videos. This gradual ease of use has turned the malicious application of forged faces into a significant threat, complicating the task of deepfake detection. Despite the notable success of current deepfake detection methods, which predominantly employ data-driven CNN classification models, these methods exhibit limited generalization capabilities and insufficient robustness against novel data unseen during training. To tackle these challenges, this paper introduces a novel detection framework, ReLAF-Net. This framework employs a restricted self-attention mechanism that applies self-attention to deep CNN features flexibly, facilitating the learning of local relationships and inter-regional dependencies at both fine-grained and global levels. This attention mechanism has a modular design that can be seamlessly integrated into CNN networks to improve overall detection performance. Additionally, we propose an adaptive local frequency feature extraction algorithm that decomposes RGB images into fine-grained frequency domains in a data-driven manner, effectively isolating fake indicators in the frequency space. Moreover, an attention-based channel fusion strategy is developed to amalgamate RGB and frequency information, achieving a comprehensive facial representation. Tested on the high-quality version of the FaceForensics++ dataset, our method attained a detection accuracy of 97.92%, outperforming other approaches. Cross-dataset validation on Celeb-DF, DFDC, and DFD confirms the robust generalizability, offering a new solution for detecting high-quality deepfake videos.

MaD-CoRN: an efficient and lightweight deepfake detection approach using convolutional reservoir network

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detection

Facial Forgery-based Deepfake Detection using Fine-Grained Features

Real-Time Advanced Computational Intelligence for Deep Fake Video Detection

Deepfake Detection System Using Deep Neural Networks

A defensive attention mechanism to detect deepfake content across multiple modalities

Combating deepfakes: a comprehensive multilayer deepfake video detection framework

One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework

Deep fake detection using an optimal deep learning model with multi head attention-based feature extraction scheme

Deep fake video/image detection using deep learning

A Lightweight CNN for Efficient Deepfake Detection of Low-resolution Images in Frequency Domain

An efficient deepfake video detection using robust deep learning

Multi-attentional Deepfake Detection

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

Deepfake Detection Based on Temporal Analysis of Facial Dynamics Using LSTM and ResNeXt Architectures

Unmasking DeepFakes with simple Features

Deep Fake Detection: Survey of Facial Manipulation Detection Solutions

A defensive framework for deepfake detection under adversarial settings using temporal and spatial features

Detection of Deepfake Video Using Residual Neural Network and Long Short-Term Memory

Comparison of Deepfake Detection Techniques through Deep Learning