Abstract:The Versatile Video Coding (VVC) standard introduces a block partitioning structure known as quadtree plus nested multi-type tree (QTMTT), which allows more flexible block partitioning compared to its predecessors, like High Efficiency Video Coding (HEVC). Meanwhile, the partition search (PS) process, which is to find out the best partitioning structure for optimizing the rate-distortion cost, becomes far more complicated for VVC than for HEVC. Also, the PS process in VVC reference software (VTM) is not friendly to hardware implementation. We propose a partition map prediction method for fast block partitioning in VVC intra-frame encoding. The proposed method may replace PS totally or be combined with PS partially, thereby achieving adjustable acceleration of the VTM intra-frame encoding. Different from the previous methods for fast block partitioning, we propose to represent a QTMTT-based block partitioning structure by a partition map, which consists of a quadtree (QT) depth map, several multi-type tree (MTT) depth maps, and several MTT direction maps. We then propose to predict the optimal partition map from the pixels through a convolutional neural network (CNN). We propose a CNN structure, known as Down-Up-CNN, for the partition map prediction, where the CNN structure emulates the recursive nature of the PS process. Moreover, we design a post-processing algorithm to adjust the network output partition map, so as to obtain a standard-compliant block partitioning structure. The post-processing algorithm may produce a partial partition tree as well; then based on the partial partition tree, the PS process is performed to obtain the full tree. Experimental results show that the proposed method achieves to encoding acceleration for the VTM-10.0 intra-frame encoder, with the ratio de- ending on how much PS is performed. Especially, when achieving encoding acceleration, the compression efficiency loss is 2.77% in BD-rate, which is a better tradeoff than the previous methods.

Partition Tree Guided Progressive Rethinking Network For In-Loop Filtering Of Hevc

Combining Progressive Rethinking and Collaborative Learning: A Deep Framework for In-Loop Filtering

Effective Quadtree Plus Binary Tree Block Partition Decision for Future Video Coding

Fast QTBT Partitioning Decision for Interframe Coding with Convolution Neural Network.

Deep In-Loop Filtering via Multi-Domain Correlation Learning and Partition Constraint for Multiview Video Coding

Improved Intra Boundary Filters for HEVC

Cnn-Based Depth Map Prediction for Fast Block Partitioning in HEVC Intra Coding.

Effective CU size decision for HEVC intracoding.

Residual Highway Convolutional Neural Networks for In-Loop Filtering in HEVC.

Implementation of In-Loop Filter for HEVC Decoder on Reconfigurable Processor

Optimization for HEVC Intra Prediction

Probabilistic Decision Based Block Partitioning for Future Video Coding.

Just Noticeable Difference Based Fast Coding Unit Partition in HEVC Intra Coding.

Partition Map Prediction for Fast Block Partitioning in VVC Intra-Frame Coding

Local-Constrained Quadtree Plus Binary Tree Block Partition Structure For Enhanced Video Coding

Combining Directional Intra Prediction And Intra Block Copy With Block Partition For Hevc

Mode Dependent Intra Smoothing Filter For Hevc

Block-Composed Background Reference for High Efficiency Video Coding

Content-Aware Convolutional Neural Network for In-Loop Filtering in High Efficiency Video Coding

Fast coding unit partitioning algorithm for HEVC

Transform-Domain In-Loop Filter With Block Similarity For Hevc