Abstract:We propose a convolutional neural network-based coefficients prediction (CNNCP) method for intra-predicted residues in the High Efficiency Video Coding (HEVC) standard. In HEVC, discrete cosine transform (DCT) or discrete sine transform (DST) is adopted to convert the intra-predicted residues in the spatial domain into coefficients in the frequency domain. Each coefficient is scalar quantized and entropy coded into the bitstream. As DCT or DST is non-optimal linear transform, there still exist linear and non-linear correlations among different coefficients after the transform. In addition, there exist coefficients' correlations between current block and neighboring blocks, as these correlations cannot be completely exploited in the intra prediction. We thus propose to perform coefficients prediction to further reduce the redundancy among coefficients. The coefficients prediction is achieved using trained convolutional neural networks (CNNs), as CNNs can build complex relationship between input and output by training with a lot of data. In addition, a flag that signals whether to perform coefficients prediction or not at the coding unit level is transmitted to decoder. The proposed CNNCP method is implemented upon the HEVC reference software. Experimental results show that the proposed method achieves on average 1.8%, 4.1%, and 4.5% BD-rate reduction ratios in Y, U, V, respectively, compared with the HEVC baseline in all-intra configuration. In particular, the average BD-rate reduction ratios for 4K test sequences are 2.9%, 6.5%, and 6.6%.

Improved Prediction Estimation Based H.264 to HEVC Intra Transcoding

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

Optimization for HEVC Intra Prediction

Machine Learning-Based H.264/AVC to HEVC Transcoding Via Motion Information Reuse and Coding Mode Similarity Analysis.

A fast intra coding algorithm for HEVC

Fast intra prediction for high efficiency video coding

Fast Intra-Encoding Algorithm for High Efficiency Video Coding

A fast intra optimization algorithm for HEVC

Efficient Multiple-Line-Based Intra Prediction for HEVC.

Multi-Scale Convolutional Neural Network-Based Intra Prediction for Video Coding.

Fast HEVC Inter Prediction Algorithm Based on Spatio-Temporal Block Information.

Effective CU size decision for HEVC intracoding.

Efficient HEVC to H.264/AVC Transcoding with Fast Intra Mode Decision.

Coding Unit and Prediction Unit Pre-selection in HEVC Intra Encoding

Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Coding

Fast Transcoding from H.264 AVC to High Efficiency Video Coding.

A Fast Intra Prediction Method for H.264 Video Coding

Improved Intra Transform Skip Mode in HEVC

A Method to Reduce the Intra-Frame Prediction Complexity of HEVC Based on D-CNN

Efficient Prediction Methods With Enhanced Spatial-Temporal Correlation for HEVC.

Convolutional Neural Network-Based Coefficients Prediction for HEVC Intra-Predicted Residues