Abstract:Motion compensation with fractional motion vector has been widely utilized in the video coding standards. The fractional samples are usually generated by fractional interpolation filters. Traditional interpolation filters are usually designed based on the signal processing theory with the assumption of band-limited signal, which cannot effectively capture the non-stationary property of video content and cannot adapt to the variety of video quality. In this paper, we reveal an intuitive property of the fractional interpolation problem, named invertibility. That is, the fractional interpolation filters should not only generate fractional samples from integer samples but also recover the integer samples from the fractional samples in an invertible manner. We prove in theory that the invertibility in the spatial domain is equivalent to the constant magnitude in the Fourier transform domain. Driven by the invertibility, we then develop a learning-based method to solve the fractional interpolation problem. Inspired by the advances of convolutional neural network (CNN), we propose to establish an end-to-end scheme using CNN to train invertibility-driven interpolation filter (InvIF). Different from the previous learning-based methods, the proposed training scheme does not need hand-crafted "ground truth" of fractional samples. The proposed InvIF is integrated into high efficiency video coding (HEVC), and extensive experiments are conducted to verify its effectiveness. The experimental results show that the proposed method can achieve on average 4.7% and 3.6% BD-rate reduction compared with the HEVC anchor, under low-delay-B and random-access configurations, respectively.

Motion-compensating Predication with Wiener Interpolation Filters

Motion adaptive de-interlace with enhanced edge oriented interpolation

Weighted Joint Inter Prediction Algorithm Of Stereo Video Encoding

Sub-pixel Motion Compensation Interpolation Filter in AVS [video Coding]

Efficient interpolation architecture design for motion compensation in H.264/AVC

Partition-level adaptive interpolation filter for video coding

Local Adaptive Filter In Predictive Coding

A Low Complexity and High Performance Interpolation Filter for MPEG IVC

Position Prediction Motion-Compensated Interpolation For Frame Rate Up-Conversion Using Temporal Modeling

Motion-compensated 3d Wavelet Video Coding Based on Adaptive Temporal Lifting Filter Implementation

Overlapped Motion Compensated Region Wavelet Coder for Very Low Bit-Rates

Witsenhausen-Wyner Video Coding

Combined adaptive-fixed interpolation with multi-directional filters

Invertibility-Driven Interpolation Filter for Video Coding.

Efficient coding with adaptive motion models

Interweaved Prediction for Video Coding.

A novel spatial-temporal position prediction motion-compensated interpolation for frame rate up-conversion

A hybrid motion-compensated de-interlace with adaptive interpolation

A Two Pass H.264-Based Matching Pursuit Video Coder

Motion Inertia-Based Algorithms for Digital Video Coding