Abstract:As the upcoming video coding standard, Versatile Video Coding (i.e., VVC) achieves up to 30% Bjøntegaard delta bit-rate (BD-rate) reduction compared with High Efficiency Video Coding (H.265/HEVC). To eliminate or alleviate different kinds of compression artifacts like blocking, ringing, blurring and contouring effects, three in-loop filters, i.e. de-blocking filter (DBF), sample adaptive offset (SAO) and adaptive loop filter (ALF), have been involved in VVC. Recently, Convolutional Neural Network (CNN) has attracted tremendous attention and shows great potential in many tasks in image processing. In this work, we design a CNN-based in-loop filter as an integrated single-model solution which is adaptive to almost any scenarios in video coding. An architecture named as ADCNN (i.e., Attention based Dual-scale CNN) with an attention based processing block is proposed to reduce artifacts of I frames and B frames, which take advantage of informative priors such as the quantization parameter (QP) and partitioning information. Different from existing CNN-based filtering methods, which are mainly designed for the luma component and may need to train different models for different QPs, the proposed filter is adapted to different QPs and different frame types, and all the components (i.e., both luma and chroma) are processed simultaneously with feature exchange and fusion between components for information supplementary. Experimental results show that the proposed ADCNN filter can achieve 6.54%, 13.27%, 15.72% BD-rate savings for Y, U, V respectively under the all intra configuration and 2.81%, 7.86%, 8.60% BD-rate savings under the random access configuration. It can be used to replace all the conventional in-loop filters and also outperforms them without increase in encoding time.

SELF-AWARE FILTER ESTIMATION FOR CROSS-COMPONENT LINEAR MODEL INTRA-PREDICTION IN VIDEO CODING

Multi-model Based Cross-Component Linear Model Chroma Intra-Prediction for Video Coding.

Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding

Spatial Information Refinement for Chroma Intra Prediction in Video Coding

Unified Cross-Component Linear Model in VVC Based on a Subset of Neighboring Samples

Self-aware Cross-component Prediction Model Based on Template for Screen Content Coding

Towards Lightweight Neural Network-based Chroma Intra Prediction for Video Coding

Adaptive Chroma Prediction Based on Luma Difference for H.266/VVC

Chroma Intra Prediction with Lightweight Attention-Based Neural Networks

Attention-Based Dual-Scale CNN In-Loop Filter for Versatile Video Coding.

A Cross-Component Prediction Model For Screen Content Coding

Sub-Sampled Cross-Component Prediction for Chroma Component Coding.

Deep Learning-Based Chroma Prediction for Intra Versatile Video Coding

Sub-Sampled Cross-Component Prediction for Emerging Video Coding Standards

Adaptive Chroma Block Vector Derivation from Luma for Screen Content Coding

A Discrete-Mapping-Based Cross-Component Prediction Paradigm for Screen Content Coding.

Efficient Cross-Component Prediction for H.266/VVC Based on Lightweight Fully Connected Networks

A Linear Model For Yuv 4:2:0 Chroma Intra Prediction

Advanced Learning-Based Inter Prediction for Future Video Coding

A Learning-Based Low Complexity In-Loop Filter for Video Coding

Enhanced line-based intra prediction with fixed interpolation filtering