Abstract:Video surveillance has various applications in various fields and industries. However, the rapid development of video processing technology has made video surveillance information susceptible to multiple malicious attacks. At present, the state-of-the-art methods, including the latest deep learning techniques, cannot get satisfactory results when addressing video surveillance object forgery detection (VSOFD) due to the following limitations: (i) lack of VSOFD-specific features for effective processing and (ii) lack of effective deep network architecture designed explicitly for VSOFD. This paper proposes a new detection scheme to alleviate these limitations. The proposed approach first extracted VSOFD-specific features via residual-based steganalysis feature (RSF) from the spatial-temporal-frequent domain. Key clues of video frames can be more effectively learned from RSF, instead of raw frame images. Then, the RSF feature is used to form the residual-based steganography feature vector group (RSFVG), which serves as the input of our following network. Finally, a new VSOFD-specific deep network architecture called parallel-DenseNet-concatenated-LSTM (PDCL) network is designed, which includes two improved CNN and RNN modules. The improved CNN module fuses and processes the coarse-to-fine feature extraction and simultaneously preserves the frame independence in video frames. The improved RNN module learns the correlation features between the adjacent frames to identify forgery frames. Experimental results show that the proposed scheme using the PDCL network with RSF can achieve high performance in test error, precision, recall, and F1 scores in our newly constructed dataset (SYSU-OBJFORG + newly generated forgery video clips). Compared to existing SOTA methods, our framework achieves the best F1 score of 90.33%, which is greatly improved by nearly 8%.

Object-Based Video Forgery Detection Via Dual-Stream Networks.

Unified Video and Image Representation for Boosted Video Face Forgery Detection

Exposing video surveillance object forgery by combining TSF features and attention-based deep neural networks

Video Forgery Detection Using Spatio-Temporal Dual Transformer.

Inter-frame Passive-Blind Forgery Detection for Video Shot Based on Similarity Analysis

Real-Time Video Forgery Detection Via Vision-WiFi Silhouette Correspondence

Video Splicing Detection and Localization Based on Multi-Level Deep Feature Fusion and Reinforcement Learning

CNN Spatiotemporal Features and Fusion for Surveillance Video Forgery Detection

FST-Net - Exploiting Frequency Spatial Temporal Information for Low-Quality Fake Video Detection.

Passive Forensic Based on Spatio-Temporal Localization of Video Object Removal Tampering

Deep Convolutional Neural Network for Robust Detection of Object-Based Forgeries in Advanced Video

End-to-end Image Splicing Localization Based on Multi-Scale Features and Residual Refinement Module

Combined spatial and frequency dual stream network for face forgery detection

Video Surveillance Object Forgery Detection using PDCL Network with Residual-based Steganalysis Feature

Towards Cross-Modal Forgery Detection and Localization on Live Surveillance Videos

A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos

Learning Dual Aggregate Features for Face Forgery Detection

Temporal Consistency Based Deep Face Forgery Detection Network.

Double-Stream Segmentation Network with Temporal Self-attention for Deepfake Video Detection

Research on video face forgery detection model based on multiple feature fusion network

UVL2: A Unified Framework for Video Tampering Localization