Abstract:In both H.264/AVC and HEVC, the angular prediction is adopted for intra coding, which only exploits the spatial correlation between the current block and its neighboring single line reference. This angular prediction can handle the main directional patterns well, however, lacks the ability to deal with other directions. In this paper, a multi-scale convolutional neural network based intra prediction is proposed to address this problem. Specifically, a predicted block is first generated by the angular prediction, then fed into the proposed network with its neighboring reconstructed $L$ -shape to generate a more accurate predicted block. On one hand, the $L$ -shape of multiple lines provides more reliable reconstructed pixels and more contextual information to get better prediction; on the other hand, the multi-scale feature extraction takes the advantage of the feature maps in different scales to further enhance the prediction. With this multi-scale structure, the $L$ -shape can be used to refine both left-above and right-bottom pixels in the predicted block during the convolution operation. Experimental results demonstrate that compared with HEVC reference software HM 16.9, the proposed intra prediction can achieve an average of 3.4% (up to 5.6%) bitrate saving with all intra configuration.

Improving Lossless Intra Coding of H.264/AVC by Pixel-Wise Spatial Interleave Prediction

An Interpolation Method by Predicting the Direction of Pixel Texture Changing Trend for H.264/AVC Intra Prediction

A Pixel-Wise Directional Intra Prediction Method

An Efficient Coding Method For Intra Prediction Mode Information

Optimization for HEVC Intra Prediction

An Improved Inter Frame Error Concealment in H.264/AVC

Fast Intra Prediction Algorithm in H.264/Avc

A Fast H.264 Intra Prediction Algorithm Using All Zero Block Detection and Texture Feature

Enhanced intra coding with joint line and pixel prediction

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

A Fast Intra Prediction Method for H.264 Video Coding

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

Improved intra prediction for high definition video using localized horizontal spatial prediction

An Efficient Intermode Decision Algorithm Based on Motion Homogeneity for H.264/AVC

Efficient Multiple-Line-Based Intra Prediction for HEVC.

Multi-Scale Convolutional Neural Network-Based Intra Prediction for Video Coding.

Smoothed Reference Inter-Layer Texture Prediction For Bit Depth Scalable Video Coding

Combined Prediction Mode for AVS

Hybrid Transform for HEVC-based Lossless Coding

Enhanced Inter Prediction with Localized Weighted Prediction in HEVC

Improved Prediction Estimation Based H.264 to HEVC Intra Transcoding