Abstract:Detection of double compression is regarded as one primary step in analyzing the integrity of digital videos, which is of prominent importance in video forensics. However, current methods are vulnerable with the severe lossy quantization in the recompression process such that it is challenging to obtain reliable frame-wise detection results, especially for the high efficiency video coding (HEVC) standard. In view of these issues, in this paper, a hybrid neural network is proposed to reveal abnormal frames in HEVC videos with double compression by learning robust spatio-temporal representations from coding information in the compression domain. Based on the statistical analysis of Coding Units (CUs), it is interesting to find that HEVC video streams contain "rich" coding information that could be leveraged to identify abnormal traces caused by double compression. Two types of coding information maps, including CU Size Map (CSM) and CU Prediction mode Map (CPM), are exploited. In contrast with the conventional paradigm relying on pixel-level representations of decoded frames, CSMs and CPMs of a short-time video clip are treated as the input, aiming to achieve high robustness against recompression of low quality. In our hybrid neural network, an attention-based two-stream residual network is proposed to learn hierarchical representations from CSM and CPM, which are then jointly optimized by the attention-based fusion module. Finally, the temporal variation is modeled by Long Short-Term Memory (LSTM) to obtain frame-wise detection results. We have conducted extensive experiments considering various video content and coding parameters, such as bitrates and sizes of Group of Picture. Experimental results show that our approach can obtain state-of-the-art performance compared with conventional methods, especially when videos are recompressed in the low bitrate coding scenarios.

An MSDCNN-LSTM framework for video frame deletion forensics

Continuity-attenuation captured network for frame deletion detection

Exposing Frame Deletion by Detecting Abrupt Changes in Video Streams

Dynamic Difference Learning with Spatio-temporal Correlation for Deepfake Video Detection

CNN Spatiotemporal Features and Fusion for Surveillance Video Forgery Detection

Video Inter-frame Tampering Detection Based on SN-VGG+BiLSTM-AE Composite Model

Inter-frame Passive-Blind Forgery Detection for Video Shot Based on Similarity Analysis

DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis

Video Frame Prediction by Deep Multi-Branch Mask Network

Frame-Wise Detection Of Double Hevc Compression By Learning Deep Spatio-Temporal Representations In Compression Domain

Missing Frame Detection of Surveillance Videos Based on Deep Learning in Forensic Science.

Exposing video surveillance object forgery by combining TSF features and attention-based deep neural networks

Passive Forensic Based on Spatio-Temporal Localization of Video Object Removal Tampering

A Recurrent Video Quality Enhancement Framework with Multi-Granularity Frame-Fusion and Frame Difference Based Attention

MDCF-Net: Multi-Scale Dual-Branch Network for Compressed Face Forgery Detection

SRTNet: a spatial and residual based two-stream neural network for deepfakes detection

Detecting Deepfake Videos Based on Spatiotemporal Attention and Convolutional LSTM

An Anti-Forensics Video Forgery Detection Method Based on Noise Transfer Matrix Analysis

FST-Net - Exploiting Frequency Spatial Temporal Information for Low-Quality Fake Video Detection.

A Light Weight Depthwise Separable Layer Optimized CNN Architecture for Object-Based Forgery Detection in Surveillance Videos