Abstract:The intensive computation of High Efficiency Video Coding (HEVC) engenders challenges for the hardwired encoder in terms of the hardware overhead and the power dissipation. On the other hand, the constrains in hardwired encoder design seriously degrade the efficiency of software oriented fast coding unit (CU) partition mode decision algorithms. A fast algorithm is attributed as VLSI friendly, when it possesses the following properties. First, the maximum complexity of encoding a coding tree unit (CTU) could be reduced. Second, the parallelism of the hardwired encoder should not be deteriorated. Third, the process engine of the fast algorithm must be of low hardware- and power-overhead. In this paper, we devise the convolution neural network based fast algorithm to decrease no less than two CU partition modes in each CTU for full rate-distortion optimization (RDO) processing, thereby reducing the encoder's hardware complexity. As our algorithm does not depend on the correlations among CU depths or spatially nearby CUs, it is friendly to the parallel processing and does not deteriorate the rhythm of RDO pipelining. Experiments illustrated that, an averaged 61.1% intraencoding time was saved, whereas the Bjøntegaard-Delta bit-rate augment is 2.67%. Capitalizing on the optimal arithmetic representation, we developed the high-speed [714 MHz in the worst conditions (125 °C, 0.9 V)] and low-cost (42.5k gate) accelerator for our fast algorithm by using TSMC 65-nm CMOS technology. One accelerator could support HD1080p at 55 frames/s real-time encoding. The corresponding power dissipation was 16.2 mW at 714 MHz. Finally, our accelerator is provided with good scalability. Four accelerators fulfill the throughput requirements of UltraHD-4K at 55 frames/s.

CNN Oriented Fast HEVC Intra CU Mode Decision

Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Coding

CNN ORIENTED FAST PU MODE DECISION FOR HEVC HARDWIRED INTRA ENCODER

CNN Oriented Fast CU Partition Decision and PU Mode Decision for HEVC Intra Encoding

Effective CU size decision for HEVC intracoding.

Enhance the HEVC Fast Intra CU Mode Decision Based on Convolutional Neural Network by Corner Power Estimation

Cnn Based Cu Partition Mode Decision Algorithm For Hevc Inter Coding

Multi-scale and Bi-path Method Based on Image Entropy and CNN for Fast CU Partition in VVC

Vlsi Friendly Fast Cu/Pu Mode Decision For Hevc Intra Encoding: Leveraging Convolution Neural Network

Fast Intra-Mode and CU Size Decision for HEVC

Texture and Correlation Based Fast Intra Prediction Algorithm for HEVC

An Effective CU Size Decision Method for HEVC Encoders

Fast Intra CU Size Decision for HEVC Based on Machine Learning

CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network

ResNet-Based Fast CU Partition Decision Algorithm for VVC

Fast HEVC Intra Coding Algorithm Based on Otsu's Method and Gradient

A Two-Stage Fast CU Size Decision Method for HEVC Intracoding.

Fast HEVC CU/PU mode decision based on ANN and texture analysis

A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications

Cnn-Based Depth Map Prediction for Fast Block Partitioning in HEVC Intra Coding.

Fast HEVC intra-CU decision partition algorithm with modified LeNet-5 and AlexNet