Abstract:Deepfake technology uses artificial intelligence to create realistic but false audio, images, and videos. Deepfake technology poses a significant threat to the authenticity of visual content, particularly in live-stream scenarios where the immediacy of detection is crucial. Existing Deepfake detection approaches have limitations and challenges, prompting the need for more robust and accurate solutions. This research proposes an innovative approach: combining eye movement analysis with a hybrid deep learning model to address the need for real-time Deepfake detection. The proposed hybrid deep learning model integrates two deep neural network architectures, MesoNet4 and ResNet101, to leverage their respective architectures' strengths for effective Deepfake classification. MesoNet4 is a lightweight CNN model designed explicitly to detect subtle manipulations in facial images. At the same time, ResNet101 handles complex visual data and robust feature extraction. Combining the localized feature learning of MesoNet4 with the deeper, more comprehensive feature representations of ResNet101, our robust hybrid model achieves enhanced performance in distinguishing between manipulated and authentic videos, which cannot be conducted with the naked eye or traditional methods. The model is evaluated on diverse datasets, including FaceForensics++, CelebV1, and CelebV2, demonstrating compelling accuracy results, with the hybrid model attaining an accuracy of 0.9873 on FaceForensics++, 0.9689 on CelebV1, and 0.9790 on CelebV2, showcasing its robustness and potential for real-world deployment in content integrity verification and video forensics applications.

Deepfake Detection Based on Temporal Analysis of Facial Dynamics Using LSTM and ResNeXt Architectures

Deep Fake Face Detection Using Long Short-Term Memory with Deep Learning Approach

Deepfake Detection System Using Deep Neural Networks

Deep fake video/image detection using deep learning

Detection of Deepfake Video Using Residual Neural Network and Long Short-Term Memory

Combating deepfakes: a comprehensive multilayer deepfake video detection framework

An efficient deepfake video detection using robust deep learning

Hybrid Deepfake Detection Utilizing MLP and LSTM

Real-Time Deepfake Video Detection Using Eye Movement Analysis with a Hybrid Deep Learning Approach

A Hybrid CNN-LSTM Approach for Precision Deepfake Image Detection Based on Transfer Learning

Detecting Deepfake Videos Based on Spatiotemporal Attention and Convolutional LSTM

A defensive framework for deepfake detection under adversarial settings using temporal and spatial features

Synthetic Content Detection in Deepfake Video using Deep Learning

Deepfake Video Detection by Combining Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN)

A Multimodal Framework for Deepfake Detection

Hybrid Deep-Learning Model for Deepfake Detection in Video using Transfer Learning Approach

Deep Fake Detection: Survey of Facial Manipulation Detection Solutions

Deepfake detection: Enhancing performance with spatiotemporal texture and deep learning feature fusion

Deepfake Video Detection Via Predictive Representation Learning

Real-Time Advanced Computational Intelligence for Deep Fake Video Detection

A Convolutional LSTM based Residual Network for Deepfake Video Detection