Abstract:The rapid advancement of deep learning and large-scale AI models has simplified the creation and manipulation of deepfake technologies, which generate, edit, and replace faces in images and videos. This gradual ease of use has turned the malicious application of forged faces into a significant threat, complicating the task of deepfake detection. Despite the notable success of current deepfake detection methods, which predominantly employ data-driven CNN classification models, these methods exhibit limited generalization capabilities and insufficient robustness against novel data unseen during training. To tackle these challenges, this paper introduces a novel detection framework, ReLAF-Net. This framework employs a restricted self-attention mechanism that applies self-attention to deep CNN features flexibly, facilitating the learning of local relationships and inter-regional dependencies at both fine-grained and global levels. This attention mechanism has a modular design that can be seamlessly integrated into CNN networks to improve overall detection performance. Additionally, we propose an adaptive local frequency feature extraction algorithm that decomposes RGB images into fine-grained frequency domains in a data-driven manner, effectively isolating fake indicators in the frequency space. Moreover, an attention-based channel fusion strategy is developed to amalgamate RGB and frequency information, achieving a comprehensive facial representation. Tested on the high-quality version of the FaceForensics++ dataset, our method attained a detection accuracy of 97.92%, outperforming other approaches. Cross-dataset validation on Celeb-DF, DFDC, and DFD confirms the robust generalizability, offering a new solution for detecting high-quality deepfake videos.

Masked Face Detection Based on Locally Nonlinear Feature Fusion.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face detection method fusing multi-layer features

Feature Agglomeration Networks for Single Stage Face Detection

Dfn: Dual Fusion Networks For Single Stage Face Detection

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Detecting Masked Faces in the Wild with LLE-CNNs

NLFA: A Non Local Fusion Alignment Module for Multi-Scale Feature in Object Detection

A Multi-Scale Fusion Convolutional Neural Network for Face Detection.

Object detection of face mask recognition based on improved faster rcnn

Nonlinear Discriminant Feature Fusion Method for Face Recognition

FCOS-Mask: Fully Convolution Neural Network for Face Mask Detection

Masked Face Detection Algorithm in the Dense Crowd Based on Federated Learning

Face Anti-Spoofing with Local Difference Network and Binary Facial Mask Supervision

Mask-R-FCN: A Deep Fusion Network for Semantic Segmentation.

Highly Occluded Face Detection: An Improved R-Fcn Approach

Local and Global Feature Attention Fusion Network for Face Recognition

Face Forgery Detection Via Multi-Feature Fusion and Local Enhancement