Abstract:Deep learning-based in-loop filters have recently demonstrated great improvement for both coding efficiency and subjective quality in video coding. However, most existing deep learning-based in-loop filters tend to develop a sophisticated model in exchange for good performance, and they employ a single network structure to all reconstructed samples, which lack sufficient adaptiveness to the various video content, limiting their performances to some extent. In contrast, this paper proposes an adaptive deep reinforcement learning-based in-loop filter (ARLF) for versatile video coding (VVC). Specifically, we treat the filtering as a decision-making process and employ an agent to select an appropriate network by leveraging recent advances in deep reinforcement learning. To this end, we develop a lightweight backbone and utilize it to design a network set $\mathcal {S}$ containing networks with different complexities. Then a simple but efficient agent network is designed to predict the optimal network from $\mathcal {S}$ , which makes the model adaptive to various video contents. To improve the robustness of our model, a two-stage training scheme is further proposed to train the agent and tune the network set. The coding tree unit (CTU) is seen as the basic unit for the in-loop filtering processing. A CTU level control flag is applied in the sense of rate-distortion optimization (RDO). Extensive experimental results show that our ARLF approach obtains on average 2.17%, 2.65%, 2.58%, 2.51% under all-intra, low-delay P, low-delay, and random access configurations, respectively. Compared with other deep learning-based methods, the proposed approach can achieve better performance with low computation complexity.

A Hardware Architecture for Adaptive Loop Filter in VVC Decoder

High-Performance Architecture of Deblocking Filter for AVS Video Coding

Area-Efficient Processing Elements-Based Adaptive Loop Filter Architecture with Optimized Memory for VVC

Optimized Adaptive Loop Filter in Versatile Video Coding.

A High-Throughput and Memory-Efficient Deblocking Filter Hardware Architecture for VVC

A High-Performance VLSI Architecture for CABAC Decoding in H.264/AVC

A Parallel Serial Filtering Mixed Advanced ID Interpolation Architecture for AVS

A Pipelined Hardware Architecture Of Deblocking Filter In H.264/Avc

Adaptive Deep Reinforcement Learning-Based In-Loop Filter for VVC.

FPGA-based implementation of the VVC low-frequency non-separable transform

A High Speed and Efficient Architecture of Vld for Avs Hd Video Decoder

Hardware Implementation of A High-Accuracy and High-Throughput Rate Estimation Unit for VVC Residual Coding.

An Efficient Real-Time Hardware Architecture for Deblocking Filter in AVS3

Hardware implementation of transform and quantization for AVS encoder

An Efficient VLSI Architecture of VLD for AVS HDTV Decoder

Hardware Efficient Integrated In-loop Filter for HEVC Encoder

A Novel Cost-Effective and Programmable VLSI Architecture of CAVLC Decoder for H.264/AVC.

Fast Algorithms and VLSI Architecture Design for HEVC Intra-Mode Decision

Efficient Interpolation Architecture Design for Motion Compensation in H.264/AVC

A Combined Deblocking Filter and SAO Hardware Architecture for HEVC

Convolutional Neural Network Based In-Loop Filter for VVC Intra Coding