Abstract:In the emerging next generation video coding standard Versatile Video Coding (VVC) developed by the Joint Video Exploration Team (JVET), sub-block-based inter-prediction plays a key role in promising coding tools such as Affine Motion Compensation (AMC) and sub-block-based Temporal Motion Vector Prediction (sbTMVP). With sub-block-based inter-prediction, a coding block is divided into sub-blocks, and the motion information of each sub-block is derived individually. Although sub-block-based inter-prediction can provide a higher quality prediction benefiting from a finer motion granularity, it still suffers two problems: uneven prediction quality and boundary discontinuity. In this paper, we present a method of interweaved prediction to further improve sub-block-based inter-prediction. With interweaved prediction, a coding block with AMC or sbTMVP mode is divided into sub-blocks with two different dividing patterns, so that a corner position of a sub-block in one dividing pattern coincides with the central position of a sub-block in the other dividing pattern. Then two auxiliary predictions are generated by AMC or sbTMVP with the two dividing patterns, independently. The final prediction is calculated as a weighted-sum of the two auxiliary predictions. Theoretical analysis and statistical data prove that interweaved prediction can significantly mitigate the two problems in sub-block-based inter-prediction. Simulation results show that the proposed methods can achieve 0.64% BD-rate saving on average with the random access configurations. On sequences with rich affine motions, the average BD-rate saving can be up to 2.54%.

Enhanced intra coding with joint line and pixel prediction

Enhanced line-based intra prediction with fixed interpolation filtering

Intra Prediction Using Multiple Reference Lines for Video Coding

Efficient Multiple-Line-Based Intra Prediction for HEVC.

Position Dependent Linear Intra Prediction for Image Coding

Multi-Scale Convolutional Neural Network-Based Intra Prediction for Video Coding.

An Efficient Coding Method For Intra Prediction Mode Information

Improved Intra Boundary Filters for HEVC

Fully Connected Network-Based Intra Prediction for Image Coding.

A Pixel-Wise Directional Intra Prediction Method

Optimization for HEVC Intra Prediction

Enhanced intra prediction and transform for video coding

Improved intra prediction for high definition video using localized horizontal spatial prediction

Intra Prediction Using Fully Connected Network for Video Coding

Improved Low-Bitrate HEVC Video Coding Using Deep Learning Based Super-Resolution and Adaptive Block Patching.

Interweaved Prediction for Video Coding.

Enhanced Intra Prediction with Recurrent Neural Network in Video Coding

Context-Adaptive Pixel Based Prediction For Intra Frame Encoding

Neural Network-Based Enhancement to Inter Prediction for Video Coding

Enhanced intra prediction for inter pictures

A Fast Intra Prediction Method for H.264 Video Coding