Abstract:In order to achieve higher coding efficiency, the Versatile Video Coding (VVC) standard includes several new components at the expense of an increase in decoder computational complexity. These technologies often create ringing and contouring effects on the reconstructed frames at a low bit rate and introduce blurring and distortion. To smooth those visual artifacts, the H.266/VVC framework supports four post-processing filter operations. The state-of-the-art CNN-based in-loop filters prefer to deploy multiple networks for various quantization parameters and frame resolutions, which increases training resources and subsequently becomes overhead at decoder frame reconstruction. This paper presents a single deep-learning-based model for sample adaptive off-set (SAO) non-linear filtering operation on the decoder side, uses feature correlation among adjacent frames, and substantiates the merits of intra–inter frame quality enhancement. We introduced a variable filter size dual multi-scale convolutional neural network (D-MSCNN) to attenuate the compression artifact and incorporated strided deconvolution to restore the high-frequency details on the distorted frame. Our model follows sequential training across all QP values and updates the model weights. Using data augmentation, weight fusion, and residual learning, we demonstrated that our model could be trained effectively by transferring the convolution prior feature indices to the decoder to produce a dense output map. The Objective measurements demonstrate that the proposed method outperforms the baseline VVC method in PSNR, MS-SSIM, and VMAF metrics and achieves an average of 5.16% bit rate saving on different test sequence categories.

Joint Luma and Chroma Multi-Scale CNN In-loop Filter for Versatile Video Coding

Multi-Density Convolutional Neural Network for In-Loop Filter in Video Coding.

Multi-Gradient Convolutional Neural Network Based In-Loop Filter For Vvc

An Integrated CNN-based Post Processing Filter For Intra Frame in Versatile Video Coding

Multi-scale and Bi-path Method Based on Image Entropy and CNN for Fast CU Partition in VVC

Joint Rate Distortion Optimization with CNN-based In-Loop Filter for Hybrid Video Coding

Gated fusion network for SAO filter and inter frame prediction in Versatile Video Coding

Adaptive CU Split Decision with Pooling-variable CNN for VVC Intra Encoding.

Convolutional Neural Network Based In-Loop Filter for VVC Intra Coding

Content-Aware Convolutional Neural Network for In-Loop Filtering in High Efficiency Video Coding

Deep Learning-Based Chroma Prediction for Intra Versatile Video Coding

One-for-All: an Efficient Variable Convolution Neural Network for In-Loop Filter of VVC

Residual in Residual Based Convolutional Neural Network In-loop Filter for AVS3

NR-CNN: Nested-Residual Guided CNN In-loop Filtering for Video Coding

A Learning-Based Low Complexity In-Loop Filter for Video Coding

Multi-model Based Cross-Component Linear Model Chroma Intra-Prediction for Video Coding.

Faster Intra-Prediction of Versatile Video Coding Using a Concatenate-Designed CNN via DCT Coefficients

Towards Next Generation Video Coding: from Neural Network Based Predictive Coding to In-Loop Filtering

Deep Multi-Task Learning Based Fast Intra-Mode Decision for Versatile Video Coding

Spatio-Temporal Convolutional Neural Network for Enhanced Inter Prediction in Video Coding

Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding