Abstract:Complexity reduction is a commonly used method to deal with complicated video coding standards, such as High Efficiency Video Coding (HEVC) and Versatile Video Coding (VVC). But the unstable performance under different video contents and Quantization Parameters (QPs) makes it difficult to precisely specify the target encoding time of every single sequence, which limits the practical use of the encoder. Inspired by rate control, in this paper, encoding time budget is regarded as a resource. We incorporate the hierarchical Group of Picture (GOP) encoding structure, the non-accelerated proportion, and block content variation within the frame, and design a top-down allocation and bottom-up feedback scheme, to achieve precise control of encoding complexity by controlling the maximum depth of QuadTree with nested Multi-type Tree (QTMT). In the scheme, Temporal ID (Tid)-based, Sum of Absolute Transformed Difference (SATD)-based methods and Linear (L) Model are designed to facilitate weighted allocation and feedback. The relationship between Planar Cost and encoding time is exploited as a Time-Cost (T-C) model, which guides the selection of Largest Coding Unit (LCU) encoding strategies in I-frames. For B-frames, we investigate a switching suppression assisted status-based method, to efficiently decide the encoding strategy of each LCU. Through the collaboration of the proposed technologies in the scheme, given any encoding time target achievable, encoding strategies will be automatically switched to help the actual encoding time gradually approach the target. To the best of our knowledge, this work is the first work on VVC-based encoding complexity control. The proposed scheme supports directly specifying the target encoding time or target Frame Per Second (FPS), and accurately realizing it within one pass. According to experimental results, under the target encoding time ratio of 80%, 60% and 40%, the average encoding time error is kept under 0.24%, 0.03% and 0.02% by our method, outperforming state-of-the-art works base on HEVC. These results prove the advantage of the proposed scheme.

A Real-Time Low-Power Coding Bit-Rate Control Scheme for High-Efficiency Video Coding in a Multiprocessor System-on-Chip

Bandwidth-Aware High-Efficiency Video Coding Design Scheme on a Multiprocessor System-on-Chip

An Efficient Hardware Design for HDTV H.264/AVC Encoder

High Performance Multi Transform Coding Hardware Architecture Design for H.264/AVC

Efficient pipelined CABAC encoding architecture

Perceptual Importance Analysis-Based Rate Control Method for HEVC

Adaptive Gradient Information and BFGS Based Inter Frame Rate Control for High Efficiency Video Coding

Coding Sensitive Based Approximation Algorithm for Power Efficient VBS-DCT VLSI Design in HEVC Hardwired Intra Encoder

Design of H.264/AVC Video Coder Based on Mixed Architecture

Motion attention based frame-level bit allocation scheme for H.264.

A Real-Time Rate Control Scheme and Hardware Implementation for H.264/AVC Encoders

Fast Rate Control Algorithm for High Efficiency Video Coding

Real-time Video Coding under Power Constraint Based on H.264 Codec.

Complexity Control Algorithm Based on Adaptive Mode Selection for Interframe Coding in High Efficiency Video Coding

Fast Algorithms and VLSI Architecture Design for HEVC Intra-Mode Decision

Picture Quality Assessment-Based on Rate Control for Variable Bandwidth Networks

A Novel R-D Optimized MB-level Rate Control Scheme for Real-Time Video Coding

Precise Encoding Complexity Control for Versatile Video Coding

An Efficient Rate Control Scheme for Video Compression in Low-latency Interoperable Interfaces

A High-Performance Rate Control Algorithm in Versatile Video Coding Based on Spatial and Temporal Feature Complexity

A Fast CABAC Hardware Design for Accelerating the Rate Estimation in HEVC