Abstract:Video surveillance has various applications in various fields and industries. However, the rapid development of video processing technology has made video surveillance information susceptible to multiple malicious attacks. At present, the state-of-the-art methods, including the latest deep learning techniques, cannot get satisfactory results when addressing video surveillance object forgery detection (VSOFD) due to the following limitations: (i) lack of VSOFD-specific features for effective processing and (ii) lack of effective deep network architecture designed explicitly for VSOFD. This paper proposes a new detection scheme to alleviate these limitations. The proposed approach first extracted VSOFD-specific features via residual-based steganalysis feature (RSF) from the spatial-temporal-frequent domain. Key clues of video frames can be more effectively learned from RSF, instead of raw frame images. Then, the RSF feature is used to form the residual-based steganography feature vector group (RSFVG), which serves as the input of our following network. Finally, a new VSOFD-specific deep network architecture called parallel-DenseNet-concatenated-LSTM (PDCL) network is designed, which includes two improved CNN and RNN modules. The improved CNN module fuses and processes the coarse-to-fine feature extraction and simultaneously preserves the frame independence in video frames. The improved RNN module learns the correlation features between the adjacent frames to identify forgery frames. Experimental results show that the proposed scheme using the PDCL network with RSF can achieve high performance in test error, precision, recall, and F1 scores in our newly constructed dataset (SYSU-OBJFORG + newly generated forgery video clips). Compared to existing SOTA methods, our framework achieves the best F1 score of 90.33%, which is greatly improved by nearly 8%.

Real-Time Video Forgery Detection Via Vision-WiFi Silhouette Correspondence

Nowhere to Hide: Detecting Live Video Forgery via Vision-WiFi Silhouette Correspondence.

Forgery Attack Detection in Surveillance Video Streams Using Wi-Fi Channel State Information

Towards Cross-Modal Forgery Detection and Localization on Live Surveillance Videos

Self-supervised Multi-Modal Video Forgery Attack Detection

Unified Video and Image Representation for Boosted Video Face Forgery Detection

Inter-frame Passive-Blind Forgery Detection for Video Shot Based on Similarity Analysis

Video Forgery Detection Using Spatio-Temporal Dual Transformer.

Image Analysis of Facial Blood Vessels for Anti-Spoofing of Printed Image and 3D Mask Attacks

Exposing video surveillance object forgery by combining TSF features and attention-based deep neural networks

FST-Net - Exploiting Frequency Spatial Temporal Information for Low-Quality Fake Video Detection.

Identifying Video Forgery Process Using Optical Flow

Detection of Deepfake Videos Using Long-Distance Attention

CNN Spatiotemporal Features and Fusion for Surveillance Video Forgery Detection

Forgery Detection by Weighted Complementarity Between Significant Invariance and Detail Enhancement

Robust Image Forgery Detection Against Transmission Over Online Social Networks

Temporal Consistency Based Deep Face Forgery Detection Network.

Recovering Surveillance Video Using RF Cues

Video Surveillance Object Forgery Detection using PDCL Network with Residual-based Steganalysis Feature

UniForensics: Face Forgery Detection via General Facial Representation

Spatial-Temporal Frequency Forgery Clue for Video Forgery Detection in VIS and NIR Scenario.