A VLSI Design of Macro Block Mode Decision for H.264/AVC Inter Encoding

Xixin Cao

2007-01-01

Abstract:In this paper, based on the analysis of implementation cost for low complexity (RDO_off) and high complexity (RDO_on) inter macro block (MB) mode decision, a VLSI architecture of low complexity inter MB mode decision for H.264/AVC encoder chip (SoC) is proposed. Moreover, the design is implemented on FPGA development board.

What problem does this paper attempt to address?

A fast MPEG-4 to H.264/AVC intra frame transcoding algorithm

Weidong Wang,Shaojie Wang,Yafei Zhao,Yuehai Wang,Mochi Zhu,Qingqing Ye

DOI: https://doi.org/10.1109/icise.2010.5690132

2010-01-01

Abstract:This paper presents an intra-frame coding mode decision algorithm for MPEG-4 to H.264/AVC transcoding in integer transform domain. The edge direction inside a block is estimated in the integer transform domain to reduce candidate prediction modes. Based on the analysis of the variance of the sixteen subblock DC coefficients inside a macroblock, “transition interval” and “double thresholds” intra prediction size selection are proposed to reduce wrong judgments. According to statistical results of high probability of neighboring blocks having the same intra prediction mode, a decision rule is given to predict the coding mode of the current block from its neighbors. The proposed transcoding algorithm can reduce computation time by more than 75% comparing with the pixel domain cascaded intra-frame transcoder, while maintains similar picture quality and bitrate.
A highly efficient pipeline architecture of RDO-based mode decision design for AVS HD video encoder

Chuang Zhu, Yuan Li, Hui-zhu Jia, Xiao-dong Xie, Hai-bing Yin

DOI: https://doi.org/10.1109/ICME.2011.6011975

2011-01-01

Abstract:Like H.264, AVS video coding standard also uses macroblock (MB) based motion compensation (MC) and mode decision (MD). Rate distortion optimization (RDO) is the best known mode decision method, but with a high computational complexity that limits its applications. In our paper, firstly an MD algorithm based on RDO is given, which makes more mode candidates enter into RDO mode decision with little hardware resource increment. We further analyze the pipeline structure in detail, and implement a block-level 5-stage hardware pipeline. It can support the real time RDO mode decision processing of 1080P@30fps, and the coding efficiency is about 0.5db higher than the traditional SAD method. Our design is described in high-level Verilog/VHDL hardware description language and implemented under SMIC 0.18-µm CMOS technology with 215K logic gates and 80 KB SRAMs.
Fast Algorithms and VLSI Architecture Design for HEVC Intra-Mode Decision

Xiaofeng Huang,Huizhu Jia,Binbin Cai,Chuang Zhu,Jie Liu,Mingyuan Yang,Don Xie,Wen Gao

DOI: https://doi.org/10.1007/s11554-015-0549-8

IF: 2.293

2015-01-01

Journal of Real-Time Image Processing

Abstract:The emerging intra-coding tools of High Efficiency Video Coding (HEVC) standard can achieve up to 36 % bit-rate reduction compared to H.264/AVC, but with significant complexity increase. The design challenges, such as data dependency and computational complexity, make it difficult to implement a hardware encoder for real-time applications. In this paper, firstly, the data dependency in HEVC intra-mode decision is fully analyzed, which is cost by the reconstruction loop, the Most Probable Mode, the context adaption during Context-based Adaptive Binary Arithmetic Coding based rate estimation, and the Chroma derived mode. Then, several fast algorithms are proposed to remove the data dependency and to reduce the computational complexity, which include source signal based Rough Mode Decision, coarse to fine rough mode search, Prediction Mode Interlaced RDO mode decision, parallelized context adaption and Chroma-free Coding Unit (CU)/Prediction Unit (PU) decision. Finally, the parallelized VLSI architecture with CU reordering and Chroma reordering scheduling is proposed to improve the throughput. The experimental results demonstrate that the proposed intra-mode decision achieves 41.6 % complexity reduction with 4.3 % Bjontegaard Delta Rate (BDR) increase on average compared to the reference software, HM-13.0. The intra-mode decision scheme is implemented with 1571.7K gate count in 55 nm CMOS technology. The implementation results show that our design can achieve 1080p@60fps real time processing at 294 MHz operation frequency.
Design of H.264/AVC Video Coder Based on Mixed Architecture

ZHANG Wei-bing,LI Xian-hua,SHI Xu-li,TENG Guo-wei,ZHANG Zhao-yang

DOI: https://doi.org/10.3969/j.issn.1002-8692.2007.10.010

2007-01-01

Abstract:A design and implementation method of H.264/AVC encoder based on mixed structure is introduced,in which DSP is used as a main processor and FPGA as an assistant processor to accelerate arithmetic by hardware. In order to meet required real-time performance,hardware engine is designed for the most complicated and time-consuming module. According to the engine,it constitutes a software and hardware communication agreement,which makes control and data transporting easily,and realizes the real-time performances which H.264/AVC D1 coder needs.
Macroblock Feature and Motion Involved Multi-Stage Fast Inter Mode Decision Algorithm in H.264/AVC Video Coding

Yiqing Huang,Qin Liu,Shuijiong Wu,Zhewen Zheng,Takeshi Ikenaga

DOI: https://doi.org/10.1587/transfun.e92.a.3361

2009-01-01

Abstract:One fast inter mode decision algorithm is proposed in this paper. The whole algorithm is convoluted with block matching process. Firstly, beforeME process, by exploiting spatial and temporal information, a skip mode early detection algorithm is proposed. Also, in this stage, edge gradient is used to filter out unpromising modes. Secondly, during the ME stage, the original search window is separated into several layers and our fast decision scheme works with motion information of each layer. Moreover, before stepping into small modes, the distribution of SAD (sum-of-absolute-difference) and RD (rate distortion) costs of big modes are analyzed in an early stage to accelerate the inter mode decision process. Experiments show that our algorithm can achieve a speed-up factor of up to 66.0% with trivial bit increment and quality degradation.
An Efficient Intermode Decision Algorithm Based on Motion Homogeneity for H.264/AVC

Zhi Liu,Liquan Shen,Zhaoyang Zhang

DOI: https://doi.org/10.1109/tcsvt.2008.2005804

IF: 5.859

2009-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The latest video coding standard H.264/AVC significantly outperforms previous standards in terms of coding efficiency. H.264/AVC adopts variable block sizes ranging from 4 times 4 to 16 times 16 in inter frame coding, and achieves significant gain in coding efficiency compared to coding a macroblock (MB) using regular block size. However, this new feature causes extremely high computation complexity when rate-distortion optimization (RDO) is performed using the scheme of full mode decision. This paper presents an efficient intermode decision algorithm based on motion homogeneity evaluated on a normalized motion vector (MV) field, which is generated using MVs from motion estimation on the block size of 4 times 4. Three directional motion homogeneity measures derived from the normalized MV field are exploited to determine a subset of candidate intermodes for each MB, and unnecessary RDO calculations on other intermodes can be skipped. Experimental results demonstrate that our algorithm can reduce the entire encoding time about 40% on average, without any noticeable loss of coding efficiency.
Low complexity RDO mode decision based on a fast coding-bits estimation model for H.264/AVC

Qiang Wang,Debin Zhao,Wen Gao,Siwei Ma

DOI: https://doi.org/10.1109/ISCAS.2005.1465375

2005-01-01

Abstract:Rate distortion optimization (RDO) is a very efficient tool for deciding a macroblock's coding mode, which has been adopted by the H.264/AVC codec and brings higher coding efficiency. However, due to the precise calculation of the current macroblock's distortion and coding-bits for each coding mode, RDO-based mode decision involves high computational complexity. In this paper, a simple model for quickly estimating the coding-bits of the quantized transform coefficients, which account for the major part of the computation when coding a macroblock, is presented. The model only uses nonzero coefficients' magnitude and coordinates information by add operations to fulfill estimation so that computational complexity can be significantly reduced. Experimental results show that with this model the computational complexity of RDO-based mode decision in the H.264/AVC codec can be reduced by 40-60% while coding efficiency has little drop.
Residual analysis based fast inter mode decision for H.264/AVC

chen liu,tianruo zhang,xin jin,minghui wang,satoshi goto

DOI: https://doi.org/10.1109/ISPACS.2009.5383831

2009-01-01

Abstract:H.264/AVC introduces the variable block size macroblock mode for motion estimation, which brings huge computational cost. In this paper, a novel fast inter macroblock mode decision algorithm for H.264/AVC has been proposed. The proposed algorithm evaluates the modes based on residual information. The residual is obtained after the motion search of P16 Ã 16 mode or P8 Ã 8 mode. Then the characteristic of the blocks are extracted by the defined conversion, and the complexity and similarity are calculated for the decision the next conducting mode. The mode with the minimal R-D cost is chosen as the final mode. The simulation results show that, the proposed algorithm achieves 65.95% time-saving, which is 1.5 times than that of other algorithm with less PSNR loss and bit rate increase.
System-on-chip Design for a Statistical Decoder

Liang-Hao Wang,Zheng Zhu,Kai Luo,Bingbo Li,Ming Zhang

DOI: https://doi.org/10.1109/icasic.2007.4415793

2007-01-01

Abstract:In this paper, we propose a system-on-chip software hardware co-design for a statistical decoder. We use the context-based adaptive binary arithmetic decoder (CABAC decoder) used in the High profile of the H.264/AVC video coding standard as a design example. The design is aimed to strike a balance between software modules and hardware modules based on design constraints. It is capable of decoding one bin per clock cycle at high clock frequencies while maintaining a slim hardware footprint. Compared to existing statistical decoders, this design is aimed for a fast and compact IP core, well verified with standard video test sequence, and ideal for a SoC implementation.
A High-Performance VLSI Architecture for CABAC Decoding in H.264/AVC

Li Bingbo,Zhang Ding,Fang Jian,Wang Lianghao,Zhang Ming

DOI: https://doi.org/10.1109/icasic.2007.4415749

2007-01-01

Abstract:A mixed hardware/software architecture for CABAC decoding in H.264/AVC is proposed in this paper. For the purpose of flexibility, ctxldx calculation process is implemented by software, while others are implemented by hardware. An optimized parallel decoding architecture that allows decoding two binary symbols at one clock cycle is designed to enhance overall decoding performance. An efficient scheme of accessing context models is presented. Experimental results show that the proposed architecture improves the decoding performance by 20% compared to conventional scheme. The proposed design can achieve HDTV 1080i video processing requirement when operated at 140 MHz.
Novel Intermode Decision Algorithm in H.264/AVC

Liquan Shen,Zhi Liu,Zhaoyang Zhang,Leirui Wang,Guozhong Wang

DOI: https://doi.org/10.1117/1.2841715

IF: 0.829

2008-01-01

Journal of Electronic Imaging

Abstract:H.264/AVC employs variable-size motion compensation with multiple reference frames that can significantly improve the coding performance compared with the previous video coding standards. However, the computational complexity of the H.264/AVC encoder increases dramatically due to the various size modes used. One of the most challenging problems in implementing this encoder is mode decision. We propose a novel intermode decision algorithm (NIMDA) to reduce the candidate mode set, which utilizes two basic elements, the sum absolute difference (SAD) of each 44 block from the initial test of the inter-1616 and the texture characteristic. Simulation results show that our proposed algorithm can save about 46% in computational complexity, with negligible loss of coding efficiency.
A H.264 Intra Prediction Mode Decision Algorithm and VLSI Implementation

HUANG Kai,QIN Xing,YAN Xiao-lang,GE Hai-tong

DOI: https://doi.org/10.3321/j.issn:0372-2112.2007.02.004

2007-01-01

Abstract:The complexity of H.264 hardware intra encoder is remarkable due to 17 prediction modes and Rate-distortion optimization mode decision.Although reduce coding complexity greatly,most of current intra prediction mode decision algorithms are hard to implement in hardware.A new mode decision algorithm for VLSI implementation is proposed based on Sobel edge detection mode decision algorithm.Our algorithm decreases memory bandwidth by modifying Sobel edge detector of part pixels,reduces hardware design complexity by optimizing mode region range,and simplifies cost computations of each prediction mode by using SATD.The results of experiment and hardware design show that our algorithm can greatly reduce the complexity of hardware implementation and significantly improve the efficiency of coder while coding quality is decreased slightly.
A Fast Inter Mode Decision Algorithm Based on AVS Video Coding

WANG Lei-rui,SHEN Li-quan,ZHANG Zhao-yang

DOI: https://doi.org/10.3969/j.issn.1006-8961.2007.10.024

2007-01-01

Abstract:AVS1-P2 introduces several prediction modes for inter coding. In order to achieve the best coding efficiency,the rate distortion optimization is exploited to choose the most suitable predicting mode,but it is very computationally expensive.In this paper,according to the characteristics of AVS1-P2 integer transform,we propose a new fast inter mode decision algorithm to improve the encoder speed based on two criterions,early termination based on all zero block detection and the prediction of inter-mode size using texture characteristic of macroblock.Compared with the reference code,simulation results show that this method will reduce the computing complexity of encoder and improve the encoding efficiency of AVS1-P2 software encoder while bit-rate and video quality almost remain unchanged.
A Novel H.264 QP Adaptive MPDC Block-Matching Algorithm and Its VLSI Design

Chungan Peng,Xixin Cao,Xiaoxin Cui,Dunshan Yu,Shimin Sheng

DOI: https://doi.org/10.1109/icsict.2008.4734993

2008-01-01

Abstract:The computational complexity and hardware design of block-matching criteria were discussed, and a novel MPDC algorithm and its VLSI structure for H.264 were presented, in which a QP adaptive MPDC threshold was derived from the basics of H.264 4 X 4 integer transform and 52-level scalar quantization and the calculation process was adjusted for hardware optimization. When QP is greater than 18, the proposed criterion performs as well as SAD scheme, and the RDO curve error is less than 0.3 dB. Verilog HDL and SYNOPSYS DC-Shell are used for its VLSI design and implementation, and the synthesis results show that its 4 X 4 block-parallel structure saves 58% area and 77% power comparing with that of SAD's at 200MBz. It is useful for some high-compression-ratio, low-cost and low-power video codec VLSI solutions.
Efficient Macroblock Pipeline Structure In High Definition Avs Video Encoder Vlsi Architecture

Hai Bing Yin,Hong Gang Qi,Huizhu Jia,Don Xie,Wen Gao

DOI: https://doi.org/10.1109/ISCAS.2010.5537498

2010-01-01

Abstract:In traditional four-stage pipeline structures for H. 264 video encoder hardware implementation, rate distortion optimization (RDO) based mode decision was turned off, and dual-port or ping-pang on-chip search window SRAM was used to achieve data reuse between the integer and fractional pixel motion estimation. To support RDO based mode decision for efficient high definition AVS video coding implementation, we propose an improved four-stage MB pipeline structure. Also on-chip buffer structure is optimized to achieve the balance between circuit consumption and coding performance. The Jizhun profile AVS video encoder is successfully mapped into hardware implementation with the proposed pipeline structure with small performance degradation.
An Early Mode Decision Algorithm for the Enhancement Layers in H.264 Scalable Video Coding

Chun Yuan,Bolin Xu

DOI: https://doi.org/10.4028/www.scientific.net/amm.263-266.246

2012-01-01

Applied Mechanics and Materials

Abstract:This paper presents a early mode decision algorithm, which is proposed to reduce the complexity of the mode selection process for enhancement layers in H.264 Scalable Video Coding. The proposed algorithm consists of the following three main steps. We firstly divide all the macroblocks into 4 classes according to the mode of collocated macroblocks in the base layer. Then, the macroblocks are subdivided with trained BP (Back Propagation) network according to the mode of neighboring macroblocks. Finally, we choose different mode selection algorithms for different divided cases, and check whether the algorithms are agreeable. Compared to JSVM 9.18, experiment results show that, with this algorithm, 30% encoding time can be saved with a negligible loss in BDSNR, and BDBR can be significantly reduced.
Fast Mode Decision for H.264 Inter Frame Encoding Based on Statistics of Macroblock

Huizhong Li

2008-01-01

Abstract:Variable-sized block inter prediction mode decision of H.264/AVC improves coding efficiency at the cost of expensive computation.To reduce computation burden,a fast mode decision algorithem based on the statistics of the macroblock is proposed.According to the statistical characteristics about the best mode and the cost of RDO,advisable thresholds are proposed to stop mode desicision earlier and reduce computational load.The experimental results show that the algorithem can averagely save the encoding time for about 30%,and performance loss is neglectable.
An Efficient Zigzag Scanning and Entropy Coding Architecture Design.

Tongbing Cui,Chuang Zhu,Yangang Cai,Meng Li,Huizhu Jia,Don Xie,Wen Gao

DOI: https://doi.org/10.1007/978-3-319-03731-8_33

2013-01-01

Abstract:Rate distortion optimization (RDO) technique is the best known mode decision method in recent video coding standard, such as H.264 and AVS. However, the unbearable computational burden limits its application. According to the proposed block-level pipeline architecture of RDO-based MD, we find that zigzag scanning and entropy coding are the bottlenecks. In our paper, we firstly analyze the time consumption of the bottlenecks, and then we propose our efficient zigzag scanning and entropy coding architecture. Finally, our enhanced architecture is implemented in AVS encoder. The experimental results show that 20% throughput can be increased compared with the 4-way parallel scanning and entropy coding. With the proposed architecture, the real time RDO-based MD processing of 1080P@30fps can be supported. And our design is realized in high-level Verilog/VHDL hardware description language and implemented under SMIC 0.18 μ m CMOS technology with 50K logic gates and 6 KB SRAMs at 237MHZ operation frequency.
A Highly Efficient Mode Decision Algorithm and Architecture for AVS HD Video Encoder

Shuai Li,Chuang Zhu,Fei Wang,Hui-zhu Jia

DOI: https://doi.org/10.1109/ist.2012.6295561

2012-01-01

Abstract:In Advanced Audio Video coding Standard (AVS), the utilization of variable block size ranging from 16×16 to 8×8 in inter frame encoding improves the coding efficiency significantly compared with a fixed MB partition. Rate distortion optimization (RDO) is the best known mode decision method, but the corresponding extremely high computational complexity limits its application. This paper proposes an algorithm based on the visual perception model and Sobel operator edge detection model to quickly select the best inter mode from 16×16, 16×8, 8×16 and 8×8 just by using the original pixels. We further analyze and redesign the MB level pipeline structure, and give the optimized hardware structure of the encoder. We tested different sequences including cif, 720p and 1080p, and the experimental results show that the coding efficiency is comparable with the traditional RDO method. The proposed hardware structure saves fractional motion estimation (FME) by 60% in areas and reduces the processing time by 200 cycles. Our proposed mode decision architecture can support the real time processing of 1080P@30fps.
On a Highly Efficient RDO-Based Mode Decision Pipeline Design for AVS

Chuang Zhu,Huizhu Jia,Shanghang Zhang,Xiaofeng Huang,Xiaodong Xie,Wen Gao

DOI: https://doi.org/10.1109/tmm.2013.2280446

IF: 7.3

2013-01-01

IEEE Transactions on Multimedia

Abstract:Rate distortion optimization (RDO) is the best known mode decision method, while the high implementation complexity limits its applications and almost no real-time hardware encoder is truly full-featured RDO based. In this paper, first, a full-featured RDO-based mode decision (MD) algorithm is presented, which makes more modes enter RDO process. Second, the throughput of RDO-based MD pipeline is thoroughly analyzed and modeled. Third, a highly efficient adaptive block-level pipelining architecture of RDO-based MD for AVS video encoder is proposed which can achieve the highest throughput to alleviate the RDO burden. Our design is described in high-level Verilog/VHDL hardware description language and implemented under SMIC 0.18-mu m CMOS technology with 232 K logic gates and 85 Kb SRAMs. The implementation results validate our architectural design and the proposed architecture can support real time processing of 1080P@30 fps. The coding efficiency of our adopted method far outperforms (0.57 dB PSNR gain in average) the traditional low-complexity MD (LCMD) methods and the throughput of our designed pipeline is increased by 11.3%, 19% and 17% for I, P and B frames, respectively, compared with the existed RDO-based architecture.

A VLSI Design of Macro Block Mode Decision for H.264/AVC Inter Encoding

A fast MPEG-4 to H.264/AVC intra frame transcoding algorithm

A highly efficient pipeline architecture of RDO-based mode decision design for AVS HD video encoder

Fast Algorithms and VLSI Architecture Design for HEVC Intra-Mode Decision

Design of H.264/AVC Video Coder Based on Mixed Architecture

Macroblock Feature and Motion Involved Multi-Stage Fast Inter Mode Decision Algorithm in H.264/AVC Video Coding

An Efficient Intermode Decision Algorithm Based on Motion Homogeneity for H.264/AVC

Low complexity RDO mode decision based on a fast coding-bits estimation model for H.264/AVC

Residual analysis based fast inter mode decision for H.264/AVC

System-on-chip Design for a Statistical Decoder

A High-Performance VLSI Architecture for CABAC Decoding in H.264/AVC

Novel Intermode Decision Algorithm in H.264/AVC

A H.264 Intra Prediction Mode Decision Algorithm and VLSI Implementation

A Fast Inter Mode Decision Algorithm Based on AVS Video Coding

A Novel H.264 QP Adaptive MPDC Block-Matching Algorithm and Its VLSI Design

Efficient Macroblock Pipeline Structure In High Definition Avs Video Encoder Vlsi Architecture

An Early Mode Decision Algorithm for the Enhancement Layers in H.264 Scalable Video Coding

Fast Mode Decision for H.264 Inter Frame Encoding Based on Statistics of Macroblock

An Efficient Zigzag Scanning and Entropy Coding Architecture Design.

A Highly Efficient Mode Decision Algorithm and Architecture for AVS HD Video Encoder

On a Highly Efficient RDO-Based Mode Decision Pipeline Design for AVS