Abstract:Rate–distortion optimization (RDO) is a crucial technique in block-based hybrid video encoders, which determines the coding option for a certain coding unit to achieve optimal rate–distortion (R–D) performance. However, the current RDO method, which is applied in High Efficiency Video Coding (HEVC), is far from being globally optimal as it ignores the interaction among coding options. In fact, the current coding option not only determines the R–D point of the coded unit but also influences the achievable R–D performance of the subsequent coding units due to the spatial–temporal dependencies among the block/frame optimizations. In this paper, we first investigate the R–D characteristics, including operational R–D curves and R–D dependencies, in HEVC through several simulation experiments. It is shown that under the hierarchical fixed QP setting in the HEVC encoder, the temporal R–D dependence dominates the coding process, and the distortion of the reference frame has a strong impact on that of coded frames while less influence on rate. We then introduce distortion effect factors to quantitatively measure the temporal R–D dependency. The distortion effect factor at frame level reflects the correlation degree between the current coding frame and the previous coded frames, and the one at block level reflects the influence degree that the distortion of a block to that of subsequent blocks which refer to it in temporal domain. Finally, a pre-encoding based temporal dependent RDO is proposed, which adaptively adjusts quantization parameters and Lagrange multipliers according to the distortion effect factors. Experimental results show that under configurations of low-delay B and P frames, the proposed method can achieve 5.4% and 5.5% bit rate savings on average, respectively, with around 7% encoding complexity increment, compared with the original HEVC encoder.

Temporal dependency based Lagrange multiplier adaptation for HEVC

Lagrangian Multiplier Adaptation for Rate-Distortion Optimization with Inter-frame Dependency

Lagrange Multiplier Adaptation at CTU-level for VVC Low-Delay Hierarchical Coding

Lagrange multiplier based perceptual optimization for high efficiency video coding

Pre-encoding Based Temporal Dependent Rate–distortion Optimization for HEVC

Inter-Block Dependency-Based CTU Level Rate Control for HEVC

Temporal dependency based CTU-level bit allocation for rate control

Source Distortion Temporal Propagation Analysis for Random-Access Hierarchical Video Coding Optimization

Improved HEVC Video Compression Algorithm Using Low-Complexity Frame Rate Up Conversion

Adaptive Transform Size Decision Algorithm for High-Efficiency Video Coding Inter Coding

A background proportion adaptive Lagrange multiplier selection method for surveillance video on HEVC

CTU-Level Lagrange Multiplier and QP Adaption for Random Access Hierarchical Coding in VVC

Adaptive Gradient Information and BFGS Based Inter Frame Rate Control for High Efficiency Video Coding

Temporally Dependent Rate-Distortion Optimization for Low-Delay Hierarchical Video Coding

An Effective CU Size Decision Method for HEVC Encoders

Optimal Bit Allocation at Frame Level for Rate Control in HEVC

Temporal Dependent Rate-Distortion Optimization Based on Distortion Backward Propagation

Adaptive Rate Control for High Efficiency Video Coding

Rate Distortion Optimization: A Joint Framework and Algorithms for Random Access Hierarchical Video Coding.

Rate-Distortion Optimization Based on Two-Pass Encoding for HEVC

Lagrangian Multiplier Optimization Using Correlations in Residues