Abstract:Deep learning-based in-loop filters have recently demonstrated great improvement for both coding efficiency and subjective quality in video coding. However, most existing deep learning-based in-loop filters tend to develop a sophisticated model in exchange for good performance, and they employ a single network structure to all reconstructed samples, which lack sufficient adaptiveness to the various video content, limiting their performances to some extent. In contrast, this paper proposes an adaptive deep reinforcement learning-based in-loop filter (ARLF) for versatile video coding (VVC). Specifically, we treat the filtering as a decision-making process and employ an agent to select an appropriate network by leveraging recent advances in deep reinforcement learning. To this end, we develop a lightweight backbone and utilize it to design a network set $\mathcal {S}$ containing networks with different complexities. Then a simple but efficient agent network is designed to predict the optimal network from $\mathcal {S}$ , which makes the model adaptive to various video contents. To improve the robustness of our model, a two-stage training scheme is further proposed to train the agent and tune the network set. The coding tree unit (CTU) is seen as the basic unit for the in-loop filtering processing. A CTU level control flag is applied in the sense of rate-distortion optimization (RDO). Extensive experimental results show that our ARLF approach obtains on average 2.17%, 2.65%, 2.58%, 2.51% under all-intra, low-delay P, low-delay, and random access configurations, respectively. Compared with other deep learning-based methods, the proposed approach can achieve better performance with low computation complexity.

Adaptive Wavelet Domain Filter for Versatile Video Coding (VVC)

Adaptive Video Watermarking Scheme

Simple and Efficient Loop-Filtering for Low Bit-Rate Coding

Adaptive Self-Guided Loop Filter for Video Coding

Deformable Wiener Filter for Future Video Coding

An Integrated CNN-based Post Processing Filter For Intra Frame in Versatile Video Coding

Convolutional Neural Network Based In-Loop Filter for VVC Intra Coding

An efficient deblocking filter algorithm in multi-view video coding

Optimized Adaptive Loop Filter in Versatile Video Coding.

Motion-compensated 3d Wavelet Video Coding Based on Adaptive Temporal Lifting Filter Implementation

Joint Rate Distortion Optimization with CNN-based In-Loop Filter for Hybrid Video Coding

A Low Complexity Deblocking Filtering for Multiview Video Coding

Wavelet based distributed video coding with spatial scalability

Gated fusion network for SAO filter and inter frame prediction in Versatile Video Coding

Perceptual Multiview Video Coding Based On Foveated Just Noticeable Distortion Profile In Dct Domain

Low-Rank-Based Nonlocal Adaptive Loop Filter for High-Efficiency Video Compression

Adaptive regional DCT/DWT video coding algorithm for low bit-rate

Adaptive Deep Reinforcement Learning-Based In-Loop Filter for VVC.

Parametric Non-local In-loop Filter for Future Video Coding

Adaptive blocking regional DWT video coding algorithm for low bit-rate

Partition-level adaptive interpolation filter for video coding