Motion estimation method based on homogeneous fields

Jianping Fa,Liming Zhang,Ting Zhou,Dingjia Xin,Fuxi Gan,

1997-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:Motion compensation is key technique for image sequence coding. This paper reports an improved motion estimation method by considering the homogeneity of motion fields. Comparing with the results of MPEG-I, 15-30% bit rate reduction can be obtained with the same quality of picture.

What problem does this paper attempt to address?

A Motion Estimation Algorithm for Mobile Video Communications

陈国斌,刘济林,姜超,王正友

DOI: https://doi.org/10.3969/j.issn.1007-0249.2004.05.009

2004-01-01

Abstract:In mobile multimedia communications, there is a heavy demand for low computational complexity of video coding due to the limited mobile terminals’ processing power, battery life and memory capacity. Motion estimation is the most intensive computational process in video coding. It affects not only the encoder’s performance, but also the reconstructed video quality. In this paper, based on the analysis of the characteristics of error surface and motion vector field, we propose a fast search strategy for motion estimation is proposed. Simulation results show that compared with MVFAST, no any extra memory is required in the proposed algorithm, the computational complexity will decrease over 35% at the expense of only slight degraded image quality.
Fractional Pixel Motion Estimation Based on Prediction of Flat Regions for H.264

方健,郑伟,李炳博,王匡

2008-01-01

Abstract:Motion estimation(ME) consumes most of the computational resource in a video encoder system.H.264 adopts multi-mode ME and quarter-pel accuracy fractional pixel search,which brings about large scale of computational cost not only to integer pixel ME but also to fractional pixel ME.However,the computational cost of integer pixel ME has been greatly reduced with the development of fast integer search algorithms.Therefore,fast fractional pixel ME algorithms become significantly important for real-time applications.A novel fractional pixel motion estimation based on prediction of flat regions of an image is first proposed in this paper.It reduces fractional pel search points efficiently by predicting flat homogeneous regions of the image.Experimental results show that compared to the full fractional pixel search,the proposed method can reduce 22% to 63% of fractional pixel search points while keeping the image quality and compression rate almost unchanged.
Multilevel Successive Elimination with Half-Stop Motion Estimation Algorithm in H.264

薛全,刘济林,陈建乐

DOI: https://doi.org/10.3969/j.issn.1006-8961.2004.06.011

2004-01-01

Journal of Image and Graphics

Abstract:H.264 video coding standard uses motion estimation with multiple block sizes to reduce block-matching errors for higher rate-distortion performance. But the more modes are used, the more computation is needed linearly with the number of allowed block sizes. So a fast block motion estimation algorithm named multilevel successive elimination with half-stopping (MSEHS) is provided in this paper. According to the analysis of statistical characteristics about the best modes, multilevel successive elimination algorithm is described to speed up the searching process for the larger block modes firstly, then using the middle results SAD (sum of absolute difference) and motion vector, a half-stopping principle is defined as a threshold to judge whether it is necessary to continue the motion estimation for the smaller block modes. MSEHS algorithm not only reserves the advantage of multiple block modes in motion estimation but also deletes the redundant computation in the searching process. Experimental results show that the proposed technique provides competitive performance compared with full search algorithm, that is, highly reduced computational complexity, very similar image quality and bitrate.
A Mode Correlation-Based Fractional Pixel Motion Estimation For H.264 Video Coding

Fang Jian,Zheng Wei,Zhang Ding,Wang Kuang

DOI: https://doi.org/10.1109/ICASIC.2007.4415786

2007-01-01

Abstract:Motion estimation (ME) consumes most of the computational cost in a video encoder system. H.264 adopts seven ME modes and quarter-pel accuracy fractional pixel search, which brings about large scale of computational cost to the fractional pixel ME. To apply H.264 in real-time environment requires not only fast integer pixel ME algorithm but also fast fractional pixel ME algorithms. A novel mode correlation-based fractional pixel motion estimation is proposed in this paper. It makes full use of the correlation of seven ME modes to reduce fractional pel search points in flat homogeneous regions of an image. Experimental results show that compared to the full fractional pixel search, the proposed method can reduce about 50% of fractional pixel search points with negligible degradation in image quality and compression rate. Moreover, this algorithm can integrate other fast integer and fractional pixel ME algorithm to achieve better performance.
Efficient Motion Estimation Algorithm Based on Structure Segmentation and Homogeneity Test

JP Fan,LM Zhang,T Zhou,DJ Xin,FX Gan

DOI: https://doi.org/10.1109/icsigp.1996.566214

1996-01-01

Abstract:This paper reports a novel motion estimation technique for image sequence coding based on structure segmentation and homogeneity test. In this method, the frames are first segmented into four macroblock types corresponding to stationary background, uncovered background (or new objects), moving objects and edges among them. Then the following motion estimation is only performed on the compensated macroblocks according to motion homogeneous objects, and the motion interaction among neighboring macroblocks is further used for reducing the search range. Preliminary results indicate that this technique not only reduces the estimation burden drastically but also improves SNR and subjective picture quality
Fast Multi-frame Motion Estimation Algorithms for H.264

HUANG Junhao,BI Duyan,XU Yuelei,ZHANG Ming,WANG Yan

DOI: https://doi.org/10.3969/j.issn.1000-3428.2006.12.090

2006-01-01

Abstract:H.264 codec allows seven block sizes to perform the motion compensation,and refers to several frames for searching the best motion vector to achieve lower bitrate and higher quality.Since the reference software uses the full search scheme to obtain the best performance,it will spend a lot of searching time.The motion vectors in near blocks and pints in same blocks between sequent frames are correlated.Considering this characteristics,this paper proposes efficient searching algorithms by extending famous DS algorithm to multiple reference frames.Experimental results show that such method can reduce the complexity considerably while maintaining similar PSNR and bit rate.
Half-Pixel Motion Estimation Based on Linear Prediction

ZHANG Wei-ming,XU Yuan-xin,WANG Kuang

DOI: https://doi.org/10.3969/j.issn.1006-8961.2007.01.004

2007-01-01

Journal of Image and Graphics

Abstract:In video coding system,motion estimation at half-pixel accuracy can obviously enhanced coding efficiency compared to the motion estimation at integer-pixel accuracy only.However it requires more computation at the same time.In order to reduce the computation and while enhance the speed of motion estimation at half-pixel,we proposed a novel half-pixel motion estimation algorithm named half-pixel motion estimation based on linear prediction(BLPHME) for video coding in this paper.The key point of the algorithm is setting up a linear model by analyzing the relativity between the results of integer-pixel search and half-pixel search.Then we can modify the threshold dynamically for each frame.By doing so,it can skip over the blocks that can't be benefited from the half-pixel search based on the block size.Experimental results show that significant reduction in computation of motion estimation is achieved together with the increment in bit rate by using the proposed method,but without obvious increment in bit rate and visible loss in video fidelity and increment in bit rate.Moreover,the proposed algorithm can be combined with any of the fast motion estimation algorithm at integer-pixel or half-pixel accuracy to further reduce the complexity.
Fast Multiframe Selection Algorithm Based on Spatial-Temporal Characteristics of Motion Field.

Liquan Shen,Zhi Liu,Zhaoyang Zhang

DOI: https://doi.org/10.1117/1.2991409

IF: 0.829

2008-01-01

Journal of Electronic Imaging

Abstract:H.264 adopts multiple reference frames for motion estimation. This now feature significantly improves the prediction accuracy of intercoding blocks, but it results in a considerable increase in encoder complexity. The reference software JM adopts the full search scheme of which the increased computation is in proportion to the number of searched reference frames. However the reduction of prediction residues is highly dependent on the nature of sequences, not on the number of searched frames. We propose a fast multiframe selection algorithm to deduct unnecessary reference frame searches, where the nearest reference frame (ref(0)) is first searched, and the motion vectors from ref(0) compose motion field distribution. Based on the spatial and temporal consistencies of the motion field, only a small number of MBs select multiframe motion estimation. Simulation results show that the proposed algorithm can reduce more than 50% motion estimation computation cost on average and still maintain similar coding efficiency. (C) 2008 SPIE and IS&T [DOI: 10.1117/1.2991409]
Motion Estimation Optimization for H.264/AVC Using Source Image Edge Features

Zhenyu Liu,Junwei Zhou,Satoshi Goto,Takeshi Ikenaga

DOI: https://doi.org/10.1109/tcsvt.2009.2022796

IF: 5.859

2009-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:The H.264/AVC coding standard processes variable block size motion-compensated prediction with multiple reference frames to achieve a pronounced improvement in compression efficiency. Accordingly, the computation of motion estimation increases in proportion to the product of the number of reference frame and the number of intermode. The mathematical analysis in this paper illustrates that the motion-compensated prediction errors are mainly determined by the detailed textures in the source image. The image block being rich in textures contains numerous high-frequency signals, which make variable block size and multiple reference frame techniques essential. On the basis of rate-distortion theory, in this paper, the spatial homogeneity of an image block is made as a relative concept with respect to the current quantization step. For the homogenous block, its futile reference frames and intermodes can be eliminated efficiently. It is further revealed that the sum of absolute differences value of an image block is mainly determined by the sum of its edge gradient amplitude and the current quantization step. Consequently, the image content-based early termination algorithm is proposed, and it outperforms the original method adopted by JVT reference software. Moreover, the dynamic search range algorithm based on the edge gradient amplitude of source image block is analyzed. One eminent advantage of the proposed edge-based algorithms is their efficiency to the macroblock-pipelining architecture, and another desirable feature is their orthogonality to fast block-matching algorithms. Experimental results show that when these algorithms are integrated with hybrid unsymmetrical-cross multi-hexagongrid search, an averaged 31.4-60.0% motion estimation time can be saved, whereas the averaging BDPSNR loss is 0.0497 dB for all tested sequences.
Fast Inter Mode Decision Using Spatial Property of Motion Field

Liquan Shen,Zhi Liu,Zhaoyang Zhang,Xuli Shi

DOI: https://doi.org/10.1109/TMM.2008.2001358

IF: 7.3

2008-01-01

IEEE Transactions on Multimedia

Abstract:Variable size motion estimation with multiple reference frames has been adopted by the new video coding standard H.264. It can achieve significant coding efficiency compared to coding a macroblock (MB) in regular size with single reference frame. On the other hand, it causes high computational complexity of motion estimation at the encoder. Rate distortion optimized (RDO) decision is one powerful method to choose the best coding mode among all combinations of block sizes and reference frames, but it requires extremely high computation. In this paper, a fast inter mode decision is proposed to decide best prediction mode utilizing the spatial continuity of motion field, which is generated by motion vectors from 4times4 motion estimation. Motion continuity of each MB is decided based on the motion edge map detected by the Sobel operator. Based on the motion continuity of a MB, only a small number of block sizes are selected in motion estimation and RDO computation process. Simulation results show that our algorithm can save more than 50% computational complexity, with negligible loss of coding efficiency.
An Efficient Compression Coding System for Motion Images

An Ping,Wang Jianmin,Gao Lei,Liu Jun,Zhang Zhaoyang,Wang Shuozhong

DOI: https://doi.org/10.1007/s11741-997-0013-5

1997-01-01

Abstract:An efficient compression coding system for motion images is presented. A macro-block matching technique based on the correlation between motion vectors is applied to the system. This technique effectively improves the accuracy and the speed of motion estimation, and the compression ratio. A compression ratio of 29 is attainable without visible image degradation.
Locally Refined Motion Compensation for Future Video Coding

Zhao Wang,Shiqi Wang,Xinfeng Zhang,Shanshe Wang,Siwei Ma

DOI: https://doi.org/10.1109/DCC.2018.00084

2018-01-01

Abstract:Motion compensation plays a key role in high efficiency video coding. The popular video compression standards, such as H.264/AVC and HEVC, adopt block based motion compensation technique due to its high compression efficiency and relatively low computational complexity. However, block based motion compensation may not be in accordance with the actual object boundary, potentially leading to low prediction accuracy especially in the high-texture areas. In this paper, we propose a locally refined motion compensation method to address this issue. In particular, the image segmentation is applied on the prediction block indicated by a motion vector rather than the original block to avoid explicit signaling. Furthermore, the local content is analyzed to select one segmented region and subsequently the prediction of this region is generated based on the local motion filed. Experimental results show that the proposed algorithm can achieve 0.8%, 1.1% and 1.7% bitrate savings for Random Access, Lowdelay-B and Lowdelay-P configurations respectively without introducing noticeable computational complexity.
A New Fast Motion Estimation Algorithm Based on H.264

Li Hong-ye,Liu Ming-jun,Zhang Zhi-qiang

DOI: https://doi.org/10.1109/MINES.2009.49

2009-01-01

Abstract:The block motion estimation is a very time consuming part in the H.264 video coding standard. Although many fast motion estimation algorithms have been proposed to reduce the huge calculation complexity instead of full search, the motion estimation time still can not satisfy the critical real-time application. This paper proposes a new fast motion estimation algorithm, which improves on the UMHexagonS algorithm. Firstly, the introduction of a new square pattern takes the place of the 5 x 5 spiral search to reduce the search point. Secondly, the multi-hexagon-grid search is replaced by a multi-octagon-gird search in order to reduce the computational complexity and effectively predict the optimal motion vector. Thirdly, by increasing the conditions and type of patterns, the proposed algorithm can adaptively adopt directional search patterns for different block types to accelerate the search speed. The simulation experimentation results show that the proposed algorithm can reduce 30%-40% of the computational complexity compared with the UMHexagonS algorithm without loss of its coding accuracy.
Dense Estimation of Optical Flow Field Within the MPEG-2 Compressed Domain.

Gaobo Yang,Weiwei Chen,Xiao Jing Wang,Zhaoyang Zhang

DOI: https://doi.org/10.1142/s0219467809003526

2009-01-01

International Journal of Image and Graphics

Abstract:A dense estimation of optical flow field within the MPEG-2 compressed domain is proposed, which utilizes only the compressed-domain information, i.e. motion vectors and DCT coefficients. First, motion vectors are pre-processed to estimate the DCT coefficients for P and B frames. Second, initial optical flow is estimated with Black's optical flow estimation framework, in which DC image is substituted by DC+2AC image to provide more intensity information. Third, high confidence test is exploited to generate the dense and accurate motion vector field by removing false and noisy motion vectors. It preserves the advantages of compressed domain processing and improves the existent MPEG velocity field in terms of accuracy and density. Experimental results demonstrate that the proposed approach can provide a satisfactory motion analysis for compressed-domain video object extraction.
Efficient motion estimation algorithm based on structure segmentation and compensability analysis

jianping fan,jun yu,xiangyang xue,lide wu

DOI: https://doi.org/10.1117/1.601682

IF: 1.3

1998-01-01

Optical Engineering

Abstract:We report our study of a novel motion estimation algorithm based on structure segmentation and compensability analysis, where the macroblocks in the prediction frames are classified into four types corresponding to stationary background (or stationary objects), uncovered background (or new objects), moving objects, and edges among them. Then the following motion estimation operation is only performed on the compensable macroblocks, and the motion interaction among neighboring macroblocks is further used for reducing the search range. Preliminary results indicate that this proposed technique not only reduces the estimation burden drastically but also avoids the discontinuous change of picture quality, thus resulting in improvements of the subjective picture quality in comparison with a normal fast search algorithm. (C) 1998 Society of Photo-Optical Instrumentation Engineers. [S0091-3286(98)02905-5].
Integer Pixel Motion Estimation Algorithm of H. 264 and Hardware Realization

WEI Jun,CAO Yu-hui,LI Shi-ju

DOI: https://doi.org/10.3969/j.issn.1671-7147.2007.03.011

2007-01-01

Abstract:In this paper,author proposes a novel technique for fast motion compensation which chooses different search pattern according to the type of video sequences.The paper proposes a double hexagon and diamond search pattern aimed at the video sequences to reduce the search points.The experimental results justify that the proposed algorithm can reduce the computation complexity as well as maintain the image quality.
Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

Liquan Shen,Zhi Liu,Zhaoyang Zhang,Xuli Shi

DOI: https://doi.org/10.1016/j.image.2009.02.002

2009-01-01

Abstract:The new video coding standard, H.264 uses variable size motion estimation (VS-ME), multiple reference frame motion estimation (MRF-ME) and spatial-based intra prediction with selectable block size in inter frame coding. These tools have achieved significant coding efficiency compared to coding a macroblock (MB) only based on motion-compensation in regular size with single reference frame. However, these new features also give rise to an exhaustive computation in the coding procedure since there are so many combinations of coding modes and reference frames to be tried. In this paper, a fast motion estimation algorithm based on the selective VS-MRF-ME and intra prediction is proposed to reduce H.264 coding computational complexity. The basic idea of the method is to utilize the spatiotemporal property of motion field in predicting where VS-MRF-ME and intra prediction are needed, and only in these regions VS-MRF-ME and intra coding are enabled. The motion field is generated by motion vectors from 16x16 motion estimation on the nearest reference frame. Simulation results show that the proposed algorithm can save 50% computational complexity on average, with negligible loss of coding efficiency.
An Affine Motion Compensation Framework for High Efficiency Video Coding

Li,Houqiang Li,Zhuoyi Lv,Haitao Yang

DOI: https://doi.org/10.1109/iscas.2015.7168686

2015-01-01

Abstract:As the translational motion model used in recent video coding standards cannot represent the complex motion such as rotation and zooming well, a simple local affine motion compensation framework supporting multiple reference frames is proposed in this paper to characterize the complex motion. Besides, since the commonly used fast motion estimation for affine motion model is still quite complex, a fast gradient based affine motion estimation algorithm is proposed to decrease the encoder complexity. The proposed algorithm is implemented into the test model of the newest video coding standard High Efficiency Video Coding (HEVC). Experimental results show that the bit rate reduction for sequences with complex motion can be up to 16.8%.
The Application of Morphology In Image Sequences Coding

Shuwei CEN,Zhengkai Liu,Nenghai Yu,Rong Zhang

DOI: https://doi.org/10.3321/j.issn:1002-8331.2001.07.019

2001-01-01

Abstract:Methods based on motion compensation have been widely researched and used in image sequences coding.This paper presents a method of motion compensation based on morphological transform. It determines small blockswhich have different motion vectors to the marco block which it belongs. The sizes and motion vectors of these smallblocks are calculatod and coded in algorithm. The number of bits used in coding these data can be compensated bythe number of bits of DFD which is more. It gets better results compared with MPEG-I when used in some examples.
Low bit rate video compression approach using adaptive motion compensation

Yuwen He,Yuzhuo Zhong,Shiqiang Yang

2002-01-01

Ruan Jian Xue Bao/Journal of Software

Abstract:A novel low bit rate coding approach for video compression is proposed. Different motion compensation methods are utilized according to the analysis of motion field. More accurate motion predication can be achieved because different motion estimation is applied to different area with different motion type. Thus coding efficiency can be improved compared with traditional motion compensation coding. This kind of coding approach is fit for low bit rate applications. Two motion compensation methods are used in the adaptive motion compensation coding. One is global motion compensation, which is used for the coding of background motion area, and the other is local motion compensation, which is used for coding of foreground motion area. Experimentation is made to validate the performance of the new coding method. It can be concluded that the proposed method outperforms the conventional coding method through experimental comparisons.

Motion estimation method based on homogeneous fields

A Motion Estimation Algorithm for Mobile Video Communications

Fractional Pixel Motion Estimation Based on Prediction of Flat Regions for H.264

Multilevel Successive Elimination with Half-Stop Motion Estimation Algorithm in H.264

A Mode Correlation-Based Fractional Pixel Motion Estimation For H.264 Video Coding

Efficient Motion Estimation Algorithm Based on Structure Segmentation and Homogeneity Test

Fast Multi-frame Motion Estimation Algorithms for H.264

Half-Pixel Motion Estimation Based on Linear Prediction

Fast Multiframe Selection Algorithm Based on Spatial-Temporal Characteristics of Motion Field.

Motion Estimation Optimization for H.264/AVC Using Source Image Edge Features

Fast Inter Mode Decision Using Spatial Property of Motion Field

An Efficient Compression Coding System for Motion Images

Locally Refined Motion Compensation for Future Video Coding

A New Fast Motion Estimation Algorithm Based on H.264

Dense Estimation of Optical Flow Field Within the MPEG-2 Compressed Domain.

Efficient motion estimation algorithm based on structure segmentation and compensability analysis

Integer Pixel Motion Estimation Algorithm of H. 264 and Hardware Realization

Selective VS-MRF-ME and intra coding in H.264 based on spatiotemporal continuity of motion field

An Affine Motion Compensation Framework for High Efficiency Video Coding

The Application of Morphology In Image Sequences Coding

Low bit rate video compression approach using adaptive motion compensation