Abstract:Versatile Video Coding (VVC) achieves impressive coding gain improvement (about 40%+) over the preceding High-Efficiency Video Coding (HEVC) technology at the cost of extremely high computational complexity. Such an extremely high complexity increase is a great challenge for power-constrained applications, such as Internet of video things. In the case of intra coding, VVC utilizes the brute-force recursive search for both the partition structure of the coding unit (CU), which is based on the quadtree with nested multi-type tree (QTMT), and 67 intra prediction modes, compared to 35 in HEVC. As a result, we offer optimization strategies for CU partition decision and intra coding modes to lessen the computational overhead. Regarding the high complexity of the CU partition process, first, CUs are categorized as simple, fuzzy, and complex based on their texture characteristics. Then, we train two random forest classifiers to speed up the RDO-based brute-force recursive search process. One of the classifiers directly predicts the optimal partition modes for simple and complex CUs, while another classifier determines the early termination of the partition process for fuzzy CUs. Meanwhile, to reduce the complexity of intra mode prediction, a fast hierarchical intra mode search method is designed based on the texture features of CUs, including texture complexity, texture direction, and texture context information. Extensive experimental findings demonstrate that the proposed approach reduces complexity by up to 77% compared to the latest VVC reference software (VTM-23.1). Additionally, an average coding time saving of 70% is achieved with only a 1.65% increase in BDBR. Furthermore, when compared to state-of-the-art methods, the proposed method also achieves the largest time saving with comparable BDBR loss. These findings indicate that our method is superior to other up-to-date methods in terms of lowering VVC intra coding complexity, which provides an elective solution for power-constrained applications.

CNN-based Partitioning Structure Prediction for VVC Intra Speedup: Bottom-Up-based and Top-Down-based.

Multi-scale and Bi-path Method Based on Image Entropy and CNN for Fast CU Partition in VVC

Convolutional Neural Network-based Split Prediction for VVC Intra Speedup

Light-weight CNN-based VVC Inter Partitioning Acceleration

ResNet-Based Fast CU Partition Decision Algorithm for VVC

Partition Map Prediction for Fast Block Partitioning in VVC Intra-Frame Coding

Intra Block Partition Structure Prediction Via Convolutional Neural Network.

Efficient Intra Coding Through Hierarchical CU Partition Prediction for VVC.

Fast QTMT Partition for VVC Intra Coding Using U-Net Framework

Adaptive CU Split Decision with Pooling-variable CNN for VVC Intra Encoding.

HG-FCN: Hierarchical Grid Fully Convolutional Network for Fast VVC Intra Coding

Faster Intra-Prediction of Versatile Video Coding Using a Concatenate-Designed CNN via DCT Coefficients

Fast QTMT Partition Decision Algorithm in VVC Intra Coding based on Variance and Gradient.

A Fast QTMT Partition Decision Strategy for VVC Intra Prediction

CNN-based ternary tree partition approach for VVC intra-QTMT coding

Fast QTBT Partitioning Decision for Interframe Coding with Convolution Neural Network.

Fast Versatile Video Coding (VVC) Intra Coding for Power-Constrained Applications

A Fast Decision Algorithm for VVC Intra-Coding Based on Texture Feature and Machine Learning

Cnn-Based Depth Map Prediction for Fast Block Partitioning in HEVC Intra Coding.

Cnn Based Cu Partition Mode Decision Algorithm For Hevc Inter Coding

Width-Adaptive CNN: Fast CU Partition Prediction for VVC Screen Content Coding