Abstract:Intra prediction is an important component of modern video codecs, which is able to efficiently squeeze out the spatial redundancy in video frames. With preceding pixels as the context, traditional intra prediction schemes generate linear predictions based on several predefined directions (i.e., modes) for blocks to be encoded. However, these modes are relatively simple and their predictions may fail when facing blocks with complex textures, which leads to additional bits encoding the residue. In this paper, we design a progressive spatial recurrent neural network (PS-RNN) that learns to conduct intra prediction. Specifically, our PS-RNN consists of three spatial recurrent units and progressively generates predictions by passing information along from preceding contents to blocks to be encoded. To make our network generate predictions considering both distortion and bit rate, we propose using sum of absolute transformed difference (SATD) as the loss function to train PS-RNN since SATD is able to measure rate-distortion cost of encoding a residue block. Moreover, our method supports variable-block-size for intra prediction, which is more practical in real coding conditions. The proposed intra prediction scheme achieves on average 2.5% bit-rate reduction on variable-block-size settings under the same reconstruction quality compared with HEVC.

Adaptive spatial prediction in intra coding.

Spatial Prediction Based Intra-Coding

Spatial Information Refinement for Chroma Intra Prediction in Video Coding

Spatially Scalable Video Coding with Intra Prediction in Enhancement Layer

Spatially scalable intra coding algorithm based on inter layer prediction

Optimized Spatial Recurrent Network for Intra Prediction in Video Coding

Spatial Sparsity Induced Temporal Prediction for Hybrid Video Compression

Intra-prediction Mode Decision Based on Video Temporal and Spatial Correlation

Spatial Distance Based on Intra Prediction Method

Horizontal Spatial Prediction for High Dimension Intra Coding.

Improved intra prediction for high definition video using localized horizontal spatial prediction

Progressive Spatial Recurrent Neural Network for Intra Prediction

Intra Prediction Based on Geometry Padding for Omnidirectional Video Coding

Context-Adaptive Pixel Based Prediction For Intra Frame Encoding

Inter Layer Intra Prediction Using Lower Layer Information For Spatial Scalability

A Fast Intra Prediction Method for H.264 Video Coding

An Efficient Coding Method For Intra Prediction Mode Information

A Pixel-Wise Directional Intra Prediction Method

Adjacent Pixels-based Intra Prediction Algorithm

Enhanced Intra Prediction with Recurrent Neural Network in Video Coding

Distance based intra prediction method