Abstract:In the emerging next generation video coding standard Versatile Video Coding (VVC) developed by the Joint Video Exploration Team (JVET), sub-block-based inter-prediction plays a key role in promising coding tools such as Affine Motion Compensation (AMC) and sub-block-based Temporal Motion Vector Prediction (sbTMVP). With sub-block-based inter-prediction, a coding block is divided into sub-blocks, and the motion information of each sub-block is derived individually. Although sub-block-based inter-prediction can provide a higher quality prediction benefiting from a finer motion granularity, it still suffers two problems: uneven prediction quality and boundary discontinuity. In this paper, we present a method of interweaved prediction to further improve sub-block-based inter-prediction. With interweaved prediction, a coding block with AMC or sbTMVP mode is divided into sub-blocks with two different dividing patterns, so that a corner position of a sub-block in one dividing pattern coincides with the central position of a sub-block in the other dividing pattern. Then two auxiliary predictions are generated by AMC or sbTMVP with the two dividing patterns, independently. The final prediction is calculated as a weighted-sum of the two auxiliary predictions. Theoretical analysis and statistical data prove that interweaved prediction can significantly mitigate the two problems in sub-block-based inter-prediction. Simulation results show that the proposed methods can achieve 0.64% BD-rate saving on average with the random access configurations. On sequences with rich affine motions, the average BD-rate saving can be up to 2.54%.

Adaptive Motion Vector Prediction Based On Spatiotemporal Correlation

Enhanced Motion Vector Prediction for Video Coding

A Study on the Motion Vector Prediction Schemes for AVS

An improved motion vector prediction scheme for video coding

An Efficient Hardware-Oriented Algorithm of Spatial Motion Vector Prediction for AVS HD Video Encoder

History-Based Motion Vector Prediction for Future Video Coding

Depth-based Motion Vector Prediction in 3D Video Coding.

Bi-Direction Motion Vector Retrieval Based Error Concealment Scheme for H.264/Avc

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

Adaptive Motion Vector Retrieval Schemes for H.264 Error Concealment

Diverse Subblock-Level Motion Derivation Schemes for AVS3.

Multi-stage motion vector prediction schedule strategy for AVS HD encoder

Interweaved Prediction for Video Coding.

Multi-view Video Coding Based on View Prediction

Adaptive Progressive Motion Vector Resolution Selection Based on Rate–Distortion Optimization

Motion Vector Coding and Block Merging in the Versatile Video Coding Standard

Adaptive motion vector resolution prediction in block-based video coding

Variable Block Size Motion Vector Retrieval Schemes for H.264 Inter Frame Error Concealment.

Motion Vector Prediction in Multiview Video Coding

Fast Mode Decision And Motion Estimation For Avs

Enhanced Temporal Motion Derivation Beyond VVC