Abstract:The intensive computation of High Efficiency Video Coding (HEVC) engenders challenges for the hardwired encoder in terms of the hardware overhead and the power dissipation. On the other hand, the constrains in hardwired encoder design seriously degrade the efficiency of software oriented fast coding unit (CU) partition mode decision algorithms. A fast algorithm is attributed as VLSI friendly, when it possesses the following properties. First, the maximum complexity of encoding a coding tree unit (CTU) could be reduced. Second, the parallelism of the hardwired encoder should not be deteriorated. Third, the process engine of the fast algorithm must be of low hardware- and power-overhead. In this paper, we devise the convolution neural network based fast algorithm to decrease no less than two CU partition modes in each CTU for full rate-distortion optimization (RDO) processing, thereby reducing the encoder's hardware complexity. As our algorithm does not depend on the correlations among CU depths or spatially nearby CUs, it is friendly to the parallel processing and does not deteriorate the rhythm of RDO pipelining. Experiments illustrated that, an averaged 61.1% intraencoding time was saved, whereas the Bjøntegaard-Delta bit-rate augment is 2.67%. Capitalizing on the optimal arithmetic representation, we developed the high-speed [714 MHz in the worst conditions (125 °C, 0.9 V)] and low-cost (42.5k gate) accelerator for our fast algorithm by using TSMC 65-nm CMOS technology. One accelerator could support HD1080p at 55 frames/s real-time encoding. The corresponding power dissipation was 16.2 mW at 714 MHz. Finally, our accelerator is provided with good scalability. Four accelerators fulfill the throughput requirements of UltraHD-4K at 55 frames/s.

Enhance the HEVC Fast Intra CU Mode Decision Based on Convolutional Neural Network by Corner Power Estimation

Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Coding

CNN Oriented Fast HEVC Intra CU Mode Decision

Effective CU size decision for HEVC intracoding.

Multi-scale and Bi-path Method Based on Image Entropy and CNN for Fast CU Partition in VVC

CNN Oriented Fast CU Partition Decision and PU Mode Decision for HEVC Intra Encoding

Cnn Based Cu Partition Mode Decision Algorithm For Hevc Inter Coding

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

An Effective CU Size Decision Method for HEVC Encoders

Fast Intra-Mode and CU Size Decision for HEVC

A Method to Reduce the Intra-Frame Prediction Complexity of HEVC Based on D-CNN

CNN ORIENTED FAST PU MODE DECISION FOR HEVC HARDWIRED INTRA ENCODER

Fast Intra CU Size Decision for HEVC Based on Machine Learning

Vlsi Friendly Fast Cu/Pu Mode Decision For Hevc Intra Encoding: Leveraging Convolution Neural Network

Fast HEVC intra-CU decision partition algorithm with modified LeNet-5 and AlexNet

Cnn-Based Depth Map Prediction for Fast Block Partitioning in HEVC Intra Coding.

Adaptive CU Split Decision with Pooling-variable CNN for VVC Intra Encoding.

CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

A CU-level Adaptive Decision Method for CNN-based In-Loop Filtering

A fast intra coding algorithm for HEVC