Abstract:Deep convolutional neural networks (CNNs) have achieved impressive success in enhancing the quality of compressed images/videos. These approaches mostly obtain the noise level in advance and train multiple architecture-identical models for enhancement on images/videos of known levels of noise. It largely hinders their practical applications where the noise level is unknown and resource is limited. To practically perform quality enhancement, we propose a novel blind quality enhancement framework for compressed video (BQEV), which utilizes a single network to conduct enhancement on videos compressed at various and unknown quality parameters (QPs). Since there exists feature similarity and difference among videos compressed at multiple QPs, BQEV utilizes this prior to efficiently handle enhancement on videos compressed at blind QPs, which consists of progressive feature extraction and QP-adaptive feature fusion subnets. They utilize temporal information and feature similarity to progressively extract valuable features and further employ the feature difference to conduct reasonable QP-adaptive feature fusion and quality enhancement, respectively. In the progressive feature extraction subnet, we first design a quality rank module to assign more attention to higher-quality frames for efficient utilization of temporal information, then propose a progressive extraction module to further extract features from different QPs. In the QPadaptive feature fusion subnet, we develop a quality estimation module to guide reasonable feature fusion of these extracted progressive features for stable and promising enhancement results on multiple QPs. Experimental results demonstrate that BQEV achieves 0.31 – 0.69 dB PSNR improvement compared with videos compressed at various QPs, outperforming state-ofthe-art approaches.

QEVC: Quality Enhancement-Oriented Video Coding

Enhancing Quality for HEVC Compressed Videos

A Quality Enhancement Framework with Noise Distribution Characteristics for High Efficiency Video Coding

A Quality Enhancement Network with Coding Priors for Constant Bit Rate Video Coding

Blind Quality Enhancement for Compressed Video

A CNN-based Prediction-Aware Quality Enhancement Framework for VVC

Improved Low-Bitrate HEVC Video Coding Using Deep Learning Based Super-Resolution and Adaptive Block Patching.

Deep Residual Network for Enhancing Quality of the Decoded Intra Frames of Hevc

Learned Quality Enhancement Via Multi-Frame Priors for HEVC Compliant Low-Delay Applications

Deep Convolutional Neural Network For Decompressed Video Enhancement

Deep learning-based video quality enhancement for the new versatile video coding

Patch-Wise Spatial-Temporal Quality Enhancement for HEVC Compressed Video

A deep learning approach for quality enhancement of surveillance video

Learning-Based Quality Enhancement for Scalable Coded Video over Packet Lossy Networks

A Robust Quality Enhancement Method Based on Joint Spatial-Temporal Priors for Video Coding

Decoder-side HEVC Quality Enhancement with Scalable Convolutional Neural Network.

Compression-Realized Deep Structural Network for Video Quality Enhancement

VVC In-Loop Filtering Based on Deep Convolutional Neural Network

Two-stage Multi-frame Cooperative Quality Enhancement on Compressed Video

A Video Compression Artifact Reduction Approach Combined with Quantization Parameters Estimation

Reconstruction Flow Recurrent Network for Compressed Video Quality Enhancement