Abstract:Versatile Video Coding (VVC) achieves impressive coding gain improvement (about 40%+) over the preceding High-Efficiency Video Coding (HEVC) technology at the cost of extremely high computational complexity. Such an extremely high complexity increase is a great challenge for power-constrained applications, such as Internet of video things. In the case of intra coding, VVC utilizes the brute-force recursive search for both the partition structure of the coding unit (CU), which is based on the quadtree with nested multi-type tree (QTMT), and 67 intra prediction modes, compared to 35 in HEVC. As a result, we offer optimization strategies for CU partition decision and intra coding modes to lessen the computational overhead. Regarding the high complexity of the CU partition process, first, CUs are categorized as simple, fuzzy, and complex based on their texture characteristics. Then, we train two random forest classifiers to speed up the RDO-based brute-force recursive search process. One of the classifiers directly predicts the optimal partition modes for simple and complex CUs, while another classifier determines the early termination of the partition process for fuzzy CUs. Meanwhile, to reduce the complexity of intra mode prediction, a fast hierarchical intra mode search method is designed based on the texture features of CUs, including texture complexity, texture direction, and texture context information. Extensive experimental findings demonstrate that the proposed approach reduces complexity by up to 77% compared to the latest VVC reference software (VTM-23.1). Additionally, an average coding time saving of 70% is achieved with only a 1.65% increase in BDBR. Furthermore, when compared to state-of-the-art methods, the proposed method also achieves the largest time saving with comparable BDBR loss. These findings indicate that our method is superior to other up-to-date methods in terms of lowering VVC intra coding complexity, which provides an elective solution for power-constrained applications.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to reduce the intra - coding complexity of Versatile Video Coding (VVC) in power - constrained applications. Specifically, although Versatile Video Coding (VVC) improves the coding efficiency by more than about 40% compared with the previous - generation High - Efficiency Video Coding (HEVC) technology, its computational complexity also increases significantly. This high complexity poses a huge challenge to power - constrained applications (such as video Internet of Things). The paper mentions that in terms of intra - coding, VVC adopts a coding unit (CU) partitioning structure based on quadtree and nested multi - type tree (QTMT) and 67 intra - prediction modes. Compared with 35 modes in HEVC, this further increases the computational burden. To meet this challenge, the paper proposes optimization strategies to reduce the computational overhead of CU partitioning decision - making and intra - coding mode selection. Specific measures include: 1. **Optimization of CU Partitioning Decision - making**: First, classify CUs into three categories: simple, ambiguous, and complex according to texture features. Then train two random forest classifiers to accelerate the brute - force recursive search process based on rate - distortion optimization (RDO). One classifier directly predicts the optimal partitioning mode for simple and complex CUs, and the other classifier determines the early termination of the ambiguous CU partitioning process. 2. **Fast Hierarchical Intra - mode Search Method**: Design a fast hierarchical intra - mode search method based on CU texture features (including texture complexity, texture direction, and texture context information) to reduce the complexity of intra - mode prediction. Through these optimization strategies, the paper claims to be able to significantly reduce the computational complexity while maintaining the coding performance, thus providing an effective solution for power - constrained applications. Experimental results show that the proposed method can reduce the complexity by up to 77% compared with the latest VVC reference software (VTM - 23.1), and the average coding time is saved by 70%, with only a 1.65% increase in BDBR. In addition, compared with the existing state - of - the - art methods, this method can also achieve the maximum time savings while having a comparable BDBR loss. These results indicate that this method is superior to other latest methods in reducing the intra - coding complexity of VVC and provides a preferred solution for power - constrained applications.

Fast Versatile Video Coding (VVC) Intra Coding for Power-Constrained Applications

Low complexity inter coding scheme for Versatile Video Coding (VVC)

A Fast Decision Algorithm for VVC Intra-Coding Based on Texture Feature and Machine Learning

Efficient Intra Coding Through Hierarchical CU Partition Prediction for VVC.

Fast CU size decision and intra-prediction mode decision method for H.266/VVC

Fast CU Partition for VVC Intra-Frame Coding via Texture Complexity

A novel fast intra algorithm for VVC based on histogram of oriented gradient

Fast Intra Mode Decision for VVC Based on Histogram of Oriented Gradient.

Fast QTMT Partition for VVC Intra Coding Using U-Net Framework

Deep Multi-Task Learning Based Fast Intra-Mode Decision for Versatile Video Coding

Faster Intra-Prediction of Versatile Video Coding Using a Concatenate-Designed CNN via DCT Coefficients

Early Intra CU Size Decision for Versatile Video Coding Based on a Tunable Decision Model

Rapid CU Partitioning and Joint Intra-Frame Mode Decision Algorithm

Fast CU Partition Decision Algorithm Based on Bayesian and Texture Features

VVC Intra Coding Complexity Optimization Based on Early Skipping of the Secondary Transform

Statistical Analysis of Inter Coding in VVC Test Model (VTM)

Intra Prediction and Mode Coding in VVC

Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Coding

ResNet-Based Fast CU Partition Decision Algorithm for VVC

Intra Encoding Complexity Control with a Time-Cost Model for Versatile Video Coding

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction