Abstract:Detection of double compression is regarded as one primary step in analyzing the integrity of digital videos, which is of prominent importance in video forensics. However, current methods are vulnerable with the severe lossy quantization in the recompression process such that it is challenging to obtain reliable frame-wise detection results, especially for the high efficiency video coding (HEVC) standard. In view of these issues, in this paper, a hybrid neural network is proposed to reveal abnormal frames in HEVC videos with double compression by learning robust spatio-temporal representations from coding information in the compression domain. Based on the statistical analysis of Coding Units (CUs), it is interesting to find that HEVC video streams contain "rich" coding information that could be leveraged to identify abnormal traces caused by double compression. Two types of coding information maps, including CU Size Map (CSM) and CU Prediction mode Map (CPM), are exploited. In contrast with the conventional paradigm relying on pixel-level representations of decoded frames, CSMs and CPMs of a short-time video clip are treated as the input, aiming to achieve high robustness against recompression of low quality. In our hybrid neural network, an attention-based two-stream residual network is proposed to learn hierarchical representations from CSM and CPM, which are then jointly optimized by the attention-based fusion module. Finally, the temporal variation is modeled by Long Short-Term Memory (LSTM) to obtain frame-wise detection results. We have conducted extensive experiments considering various video content and coding parameters, such as bitrates and sizes of Group of Picture. Experimental results show that our approach can obtain state-of-the-art performance compared with conventional methods, especially when videos are recompressed in the low bitrate coding scenarios.

Detection of H.266/VVC video transcoding based on refined block partition and filtering modes statistics in coding domain

Detection of Transcoded HEVC Videos Based on In-Loop Filtering and PU Partitioning Analyses.

Machine Learning-Based H.264/AVC to HEVC Transcoding Via Motion Information Reuse and Coding Mode Similarity Analysis.

Detection of Video Transcoding from AVC to HEVC Based on Intra Prediction Feature Maps

A coding unit classification based AVC-to-HEVC transcoding with background modeling for surveillance videos.

Visual Perception Based Intra Coding Algorithm for H.266/VVC

A Fast Decision Algorithm for VVC Intra-Coding Based on Texture Feature and Machine Learning

A Novel Information Hiding Method for H.266/VVC Based on Selections of Luminance Transform and Chrominance Prediction Modes

Detection of Hevc Double Compression Based on Boundary Effect of Tu and Non-Zero Dct Coefficient Distribution

An Integrated CNN-based Post Processing Filter For Intra Frame in Versatile Video Coding

Fast CU partition decision for H.266/VVC based on the improved DAG-SVM classifier model

Fast CU Partition Decision Method Based on Bayes and Improved De-Blocking Filter for H.266/VVC

Detection of Time Domain Forgery of H.265/HEVC Video

Learning based fast H.264 to H.265 transcoding.

Frame-Wise Detection Of Double Hevc Compression By Learning Deep Spatio-Temporal Representations In Compression Domain

A Fast and Performance-Maintained Transcoding Method Based on Background Modeling for Surveillance Video.

Detection of HEVC Double Compression with the Same Coding Parameters Based on Analysis of Intra Coding Quality Degradation Process.

Detection of Double Compression with the Same Coding Parameters Based on Quality Degradation Mechanism Analysis

A Two-Stage Cascaded Detection Scheme for Double HEVC Compression Based on Temporal Inconsistency

Fast CU size decision and intra-prediction mode decision method for H.266/VVC

Fast All Zero Block Detection Algorithm for Versatile Video Coding