Hardware-friendly fast rate-distortion optimization algorithm for AV1 encoder
Ran Tang,Xiaofeng Huang,Yan Cui,Xinnan Guo,Yang Zhou,Haibing Yin,Chenggang Yan
DOI: https://doi.org/10.1007/s11554-024-01535-4
IF: 2.293
2024-08-29
Journal of Real-Time Image Processing
Abstract:The rate distortion optimization (RDO) process aims at achieving optimal coding performance by determining the optimal coding mode according to a certain strategy in the AV1 video coding. However, the high computational complexity and strong data dependency in RDO impede real-time applications. To address these issues, a fast RDO algorithm suitable for hardware implementation is proposed. Firstly, we propose a high-frequency coefficients zero-setting approach to optimize the hardware memory occupation. Then, in the rate-distortion calculation stage, an efficient rate estimation method is proposed based on a statistical feature for the number of quantization coefficients, and the distortion estimation method is proposed by considering intrinsic features in the all-zero block. Finally, a reconstruction approximate model is proposed to solve the low parallelism issue caused by the coupling of pixel reconstruction and prediction data. Experimental results show that the proposed algorithm achieves 68.49% and 50.77% time-saving by 2.73% and 2.95% Bjøntegaard delta rate (BD-Rate) increase on average under all intra (AI) and random access (RA) configurations, respectively.
computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology