Abstract:Video forgery (VF) is manipulating fake videos by modifying, coordinating or generating new content in the video sequence. The generated fake videos pose a great threat to social stability, enhancing the necessity to introduce fast, efficient video forgery identification techniques. Many existing studies reported effective techniques to detect forged videos at minimal complexity. However, existing techniques failed to obtain global assessments of the entire video frames and are less robust against fast-moving objects. Thus, this article proposes a novel optimized trident encoder-decoder network with adaptive deep learning models for detecting and localizing video forgeries. Initially, the input videos are converted into multiple frames and forwarded to the encoder part of the detection network. In this encoder part, an Attention SqueezeNet (AttSNet) is proposed for obtaining three branches of frames: pristine, forgery and both (pristine and forgery). Then, the bi-directional long short-term memory (Bi-LSTM) model is introduced in the decoder part to accurately detect the presence/absence of forgery from the given video frames. After detection, the forged region is analyzed by proposing a novel Adaptive ResNet (A-ResNet) with a generative adversarial network (GAN) model in the localization process. Here, the features from forgery-detected video frames are extracted by employing A-ResNet and the forged regions are localized effectively by the GAN method. In addition, this study proposes a hybridized wild-hunt (WiH) optimizer technique to update the weight parameters of the proposed model. The proposed method is implemented in the Python platform, and the whole experiment is processed with a face forensic database. In the experimental section, the accuracy of 95.4% and 96.1% and the time complexity of 1.43 s are obtained for detection and localization, respectively.

Detecting Forged Facial Videos using convolutional neural network

Deep Convolutional Neural Network for Robust Detection of Object-Based Forgeries in Advanced Video

A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos

Forgery detection of low quality deepfake videos

LightFFDNets: Lightweight Convolutional Neural Networks for Rapid Facial Forgery Detection

Lightweight detection method for deepfake face video

Unified Video and Image Representation for Boosted Video Face Forgery Detection

Deep Face Forgery Detection

MesoNet: a Compact Facial Video Forgery Detection Network

Improving the Efficiency of Image and Video Forgery Detection Using Hybrid Convolutional Neural Networks

Detecting Deepfake-Forged Contents with Separable Convolutional Neural Network and Image Segmentation

Video forgery detection and localization using optimized attention squeezenet adversarial network

Facial Forgery-based Deepfake Detection using Fine-Grained Features

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

Common Forgery Artifact Driven Deepfake Face Detection

Detection of real-time deep fakes and face forgery in video conferencing employing generative adversarial networks

Deepfake Video Forensics based on Transfer Learning

Low-complexity Fake Face Detection Based on Forensic Similarity

An efficient deepfake video detection using robust deep learning

Multi-feature fusion based face forgery detection with local and global characteristics

A survey on face forgery detection of Deepfake