Abstract:Intra prediction is the key technology to reduce spatial redundancy in the modern video coding standard. Recently, deep learning based methods that directly generate the intra prediction by neural network achieve superior performance than traditional directional based intra prediction. However, these methods lack the ability to handle complex blocks which contain mixed directional textures or recurrent patterns since they only use the neighboring reference samples of the current one. The other intermediate information denoted as reference priors in this paper generated during the coding process is not exploited. In this paper, a Current Frame Priors assisted Neural Network (CFPNN) is presented to improve the intra prediction efficiency. Specifically, we utilize the local contextual information provided by the neighboring multiple references as the primary inference source. In addition to the neighboring references, we additionally use the other two reference priors within the current frame - the predictor searched by intra block copy (IntraBC) and the corresponding residual component. The IntraBC predictor provides useful nonlocal information to help generate more accurate prediction for complex blocks together with neighboring local information. While the residual component contains unique information that reflects the characteristics of the block to some extent is utilized to reduce the noise contained in the reconstructed reference samples. Moreover, we investigate the best way to integrate the proposed method into the codec. Experimental results demonstrate that compared to HEVC, our proposed CFPNN achieves an average of 4.1% BD-rate reduction for the luma component under the All Intra configuration.

Anti-aliasing Predictive Coding Network for Future Video Frame Prediction

Adaptive Recurrent Frame Prediction with Learnable Motion Vectors.

Analyzing and Improving the Pyramidal Predictive Network for Future Video Frame Prediction

Pyramidal Predictive Network: A Model for Visual-Frame Prediction Based on Predictive Coding Theory

Adaptive Hierarchical Motion-Focused Model for Video Prediction.

Video prediction: a step-by-step improvement of a video synthesis network

Predictive Coding Based Multiscale Network with Encoder-Decoder LSTM for Video Prediction

Towards Lightweight Neural Network-based Chroma Intra Prediction for Video Coding

Deep Frame Prediction for Video Coding

Combined Deterministic and Stochastic Streams for Visual Prediction Using Predictive Coding

Video Frame Prediction with Dual-Stream Deep Network Emphasizing Motions and Content Details.

Looking-Ahead: Neural Future Video Frame Prediction

Chroma Intra Prediction with Lightweight Attention-Based Neural Networks

Current Frame Priors Assisted Neural Network For Intra Prediction

Towards Next Generation Video Coding: from Neural Network Based Predictive Coding to In-Loop Filtering

Deep Reference Frame Interpolation Based Inter Prediction Enhancement for Versatile Video Coding

Advanced Learning-Based Inter Prediction for Future Video Coding

Prediction-assistant Frame Super-Resolution for Video Streaming

Adaptive High-Pass Kernel Prediction for Efficient Video Deblurring

Multi-Scale Convolutional Neural Network-Based Intra Prediction for Video Coding.

Memory-Augmented Auto-Regressive Network for Frame Recurrent Inter Prediction.