Summarization of Electronic Image Stabilization

Qiang Yu,Baifeng Wu,Yi Hao,Kun Zhu

DOI: https://doi.org/10.1109/caidcd.2006.329451

2006-01-01

Abstract:The common concept of electronic image stabilization techniques is introduced. Representative point matching algorithm is analyzed. Finally, a new representative point matching algorithm applied to stabilize digital image with simple harmonic vibration is presented

What problem does this paper attempt to address?

Image Stabilization Using Motion Estimation and Micro-mechanical Compensation

Chen, Yueting,Zhihai Xu,Qi Li,Huajun Feng

DOI: https://doi.org/10.1109/CISP.2008.663

2008-01-01

Abstract:Airborne and space-borne imaging systems are often limited in resolution by image degradation resulting from mechanical vibrations during image exposures. A new image stabilization method using digital motion estimation and micro-mechanical compensation is presented. Motion estimation is accomplished by an auxiliary high-speed camera using modified real-time digital image stabilization (DIS) algorithm. Then the image motions during exposure of the primary imaging system are eliminated by micro-mechanical compensation on the focal plane assembly with detected motion vectors to achieve high precision positioning. An imaging system model based on the proposed concept is built with commonly used facilities. Theoretical analysis and experimental result show that the performance of the proposed concept is convincing.
Real-time Digital Image Stabilization Method Based on Projection Algorithm and Block Matching

CHEN Yue-ting,LI Qi,XU Dong-hui,FENG Hua-jun,XU Zhi-hai

DOI: https://doi.org/10.3785/j.issn.1008-973x.2007.09.022

2007-01-01

Abstract:A real-time digital image stabilization method was presented to remove unwanted shaking phenomena in the image sequences captured by hand-held camcorders without affecting moving objects in the image sequences.Firstly,the coarse matching was performed based on gray-scale projection algorithm.Secondly,the precise matching was made based on several small block matching.Finally,the image sequences were compensated with the sum of the coarse motion vector and precise motion vector.These blocks for precise matching were selected by Laplacian transformation of reference image.The analysis and evaluation of the experimental results shows the convenient,quick-response and accurate characteristics of this method.
Performance test of optical and electronic image stabilizer for digital imaging system

Qi Li,Zhihai Xu,Huajun Feng,Yueting Chen

DOI: https://doi.org/10.1117/12.859425

2010-01-01

Abstract:We designed and fabricated test apparatus to analysis performance characteristic of optical and electronic image stabilization. The imaging system (digital video camera with image stabilization function) was fixed on a platform; vibration frequency of the platform varies with the input voltage of electrical motor, and vibration amplitude of the platform is changed through position adjustment of shaft of electrical motor. We start the vibration platform and acquire ordinary image sequence, and then turn on the stabilizer and record image sequence under optical stabilizer, afterwards, the optical stabilizer was turned off, the motion detection and compensation were used to process the acquired image frames, and the image sequence with electronic image stabilization was obtained. We analyzed and processed two kinds of image sequences from test apparatus and summarized some conclusions about performance characteristic of image stabilizer. The electronic image stabilization effect is better at low frequencies and the optical image stabilization effect is better at high frequencies. Furthermore, the improvement in the degree of image stability caused by the electronic image stabilization is basically not related to the vibration frequency, while the improvement in the degree of image stability caused by optical image stabilization increases significantly with the increase in vibration frequency.
Image Stabilization with Support Vector Machine

Wen-de Dong,Yue-ting Chen,Zhi-hai Xu,Hua-jun Feng,Qi Li

DOI: https://doi.org/10.1631/jzus.c1000236

2011-01-01

Abstract:We propose an image stabilization method based on support vector machine (SVM). Since SVM is very effective in solving nonlinear regression problems, an SVM model was constructed and trained to simulate the vibration characteristic. Then this model was used to predict and compensate for the vibration. A simulation system was built and four assessment metrics including the signal-to-noise ratio (SNR), gray mean gradient (GMG), Laplacian (LAP), and modulation transfer function (MTF) were used to verify our approach. Experimental results showed that this new method allows the image plane to locate stably on the CCD, and high quality images can be obtained.
Real-Time Digital Image Stabilization System Based on Gray Projection Algorithm

Xiaoyong Wang,Qi Li,Zhihai Xu,Huajun Feng,Yueting Chen

2006-01-01

Abstract:A real-time digital image stabilization system was presented, which was based on the gray projection algorithm. It demonstrates the application of gray projection algorithm in the field of digital image stabilization, as well as the algorithm optimizations of median filter, region selection and referenced frame selection in image stabilization system. The hardware of this system consists of vibration platform, optical lens, CCD, A/D card and computer. The software programming is implemented in Visual C++ programming environment on the DirectShow platform. Through quantitative analysis and evaluation, the result of image stabilization test shows the convenient, quick and accurate characteristics of gray projection algorithm. Also, it demonstrates itself as a feasible approach for real-time digital stabilization of cameras.
Interline image revision method for electrical image stabilization

Qi Li,Zhihai Xu,Huajun Feng

DOI: https://doi.org/10.1117/12.574026

2005-01-01

Abstract:In avigation, navigation and other fields, electrical image stabilization technique (EIS) is applied widely. Recent research for electrical image stabilization is focused on motion vector estimation, which influences accuracy of image stabilization and its applicable scope directly, and pay less attention to the relation between image stabilization algorithm and structure character of image sensor. In fact, while image sensors are interline transfer CCD, 2D rigid motion model is not accurate enough for the image stabilization algorithm. There exist the displacement between the rows in a frame, for the different rows are exposed at different time. In order to compensate the interline displacement caused by the movement of the sensor both in horizontal and vertical direction, an image revision method based on correlation was put forward for the structure character of interline transfer CCD. During exposure of each frame, the motion of camera is along uniform direction and approximately even (otherwise it is beyond application scope of EIS), so it is feasible to revise image according to the displacement at the top and the bottom of image. Image sequence was acquired by telescope with function of optical image stabilization, and then was processed by electrical image stabilization algorithm. Experiment results showed that the image fidelity has been improved remarkably after image revision processing.
A Fast Approach Against Large Foreground Motion in Real-time Image Stabilization

Xie Yajin,Feng Huajun,Xu Zhihai,Liqi,Huang Jiazi,Chen Yueting

DOI: https://doi.org/10.1117/12.2282358

2017-01-01

Abstract:Handheld electro-optical imaging devices usually suffer from shaky problems. In this paper, we present a fast robust approach for real-time image stabilization. Since the perform(1)ance of image stabilization mainly depends on global motion estimation and the accuracy of motion estimation will be affected when foreground motion happened, sudden image jitters will be introduced during stabilization. To solve this problem, conventional methods detect and remove the foreground objects in motion estimation but this way works inefficiently and fails when foreground moving objects occupy large part of image. Our method is based on the following improvements: modified ORB feature points(FPs) processing, adaptive calculation of affine transformation matrix and joint utilization of two Kalman filters. It can solve the sudden image jitter problem even when there are large foreground moving objects in the image. Qualitative and quantitative evaluations demonstrate the merits of our method. Experiments show that our method solves large foreground motion problem and achieves 35 FPS for 640*480 image on Intel Core i5-4590 CPU@3.30 GHz on the windows.
Video stabilization algorithm based on human visual characteristics

Yang ZHANG,Xuan-yin WANG

DOI: https://doi.org/10.13229/j.cnki.jdxbgxb2010.02.050

2010-01-01

Abstract:A video stabilization algorithm was proposed based on the feature block matching after analyzing the image stabilization mechanism and characteristic of human eyes. Uniform distribution mode was used to define the feature block. The motion vector was predicted according to the video jitter characteristic to decide the start point of searching. With the searching templates of both Large Diamond and Small Diamond, the feature blocks were matched under the restraints of threshold value and searching space. The effective motion vectors were chosen to achieve the motion smoothing. The original image was matched by the affine transformation matrix to obtain the stabilized video sequence. The experiment results show that the proposed algorithm stabilizes effectively the image sequence with required rapidity and real-time character.
Study on Performance Evaluation and Frequency Characteristic for Real-Time Image Stabilization System

Qi Li,Huajun Feng,Zhi-hai Xu,Yue-ting Chen

DOI: https://doi.org/10.1109/emeit.2011.6022949

2011-01-01

Abstract:In image stabilization systems based on motion detection and real-time compensation, the time of image acquisition, and motion estimation, etc. resulted in delay of compensation signal in relation to actual vibration, and the influence gradually became more significant with the increase in vibration frequency. We presented a concept of compensation degree to quantitatively evaluate and analyze the influence and used Least Squares Support Vector Machine (LS-SVM) to predict the motion, so the signal delay was effectively correction. The experiment results showed that the LS-SVM had high prediction accuracy, fast calculation speed and good stability so it was in favor of improving the frequency characteristic of image stabilization systems.
Video stabilisation based on modelling of motion imaging.

Jialin Yu,Ke Xiang,Xuan-Yin Wang,Songxiao Cao,Yang Zhang

DOI: https://doi.org/10.1049/iet-ipr.2015.0321

IF: 2.3

2016-01-01

IET Image Processing

Abstract:This study proposes a novel digital video stabilisation scheme based on modelling of motion imaging (MI). The modelling of MI eliminates the speed motion as a result of a moving car, which is ignored in other models such as rotation + translation model, and estimates movement parameters of the background in video sequences captured from cameras mounted on moving cars. The authors first analyse the...
An Approach of Electronic Image Stabilization Based on the Representative Point Matching

Jin Tang,Xiaowei Han,Zhonghu Yuan,Hongying Zhao

DOI: https://doi.org/10.1109/WGEC.2009.135

2009-01-01

Abstract:Image regions, which are not easily affected by moving target, are selected as matching region respectively. Then the matching regions are divided into a specified number of sub-regions according to a given experience value. By a presented algorithm of representative point matching(RPM), the local motion vecters(LMV)can be obtained. Median filter and mean filter are applied to get the real jitter vector, with historical motion vectors being considered. Then the video image is compensated according to the jitter vector. The effectiveness of proposed approach is verified based on the DM642 DSP video acquisition and processing experiment platform. The experimental results show that the proposed approach not only has high accuracy of electronic image stabilization(EIS), but also has good real-time performance.
A Fast Digital Image Stabilization Algorithm Based on Multiple-candidate Three-step Search

CHEN Yue-ting,FENG Hua-jun,XU Zhi-hai,LI Qi,WANG Xiao-yong

DOI: https://doi.org/10.3321/j.issn:1005-0086.2006.06.024

2006-01-01

Abstract:A new fast digital image stabilization(DIS) scheme is presented based on three-step search(TSS) algorithm and projection algorithm(PA).Multiple-candidates are used in search steps of TSS algorithm,which improves the motion estimation accuracy.The simulation experiments show that the proposed scheme is a high-speed and high-precision algorithm for image stabilization and can be used for more complicated motion estimation models.
Optimization Technique of Electronic Image Stabilization Based on Feature Matching

WANG Jing-dong,WANG Zhi-hui,ZHANG Chun,DING You-rong

DOI: https://doi.org/10.3788/gzxb20124111.1372

IF: 0.6

2012-01-01

ACTA PHOTONICA SINICA

Abstract:Electronic image stabilization still exists some problems,such as high time-consuming,low accuracy,high eror matching probability and so on.The paper takes appropriate measures to solove these problems from two aspects: feature points extraction and matching.Firstly,the FAST algorithm is adpoted to extracte the feature points,and positional precision of the feature points is improved to the level of sub-pixel.Then the RANSAC algorithm is used to eliminate the error matched points,avoid the interference of relative movement,and the global motion parameters calculated is more accurate.Experimental results show that a more higher precision and faster speed is obtained,which can also be applied for the complex shaking video containing translation,rotation shake and relative movement.
A Circular-Projection based digital image stabilization algorithm and its implementation for rotating image sequences

Tian Xie,Bo Zhu,Xie Li-jun,Yao Zheng

DOI: https://doi.org/10.1109/ICOSP.2010.5654936

2010-01-01

Abstract:In this paper, a new digital image stabilization (DIS) algorithm based on Circular-Projection is proposed to stabilize videos captured by self-rotating crafts. Considering the features of rotation movements and requirements of real-time, polar transformation and gradient projection are integrated into the algorithm, and DaVinci DM6446 ARM+DSP dual-core platform is utilized to build the system. The experimental results show that the proposed algorithm with this embedded system can achieve good stabilizing accuracy with processing speed of 38.3 fps for 480×320 video sequences. © 2010 IEEE.
Imaging Simulation and Restoration for Mobile-based Long-focus Camera with Optical Stabilization

Tianchen Qiu,Jingwen Zhou,Huajun Feng,Qi Li,Tongyue Li,Yueting Chen

DOI: https://doi.org/10.1364/ao.522643

IF: 1.9

2024-01-01

Applied Optics

Abstract:Image stabilization technology of the mobile-based long-focus camera is an influential factor that limits the imaging quality. Among them, the periscope lens system is a common choice and is capable of compensating for the external vibration by rotating its prism. To further investigate the impact of residual vibration during the optical image stabilization process, we propose an imaging simulation method to quantify the degradation and construct the corresponding dataset for training. We decompose the degradation into translation perpendicular to the optical axis on the image plane and defocus parallel to the optical axis. The defocus blur pattern is modified to better reproduce the spatially variant deterioration caused by defocus. Constructing synthetic datasets through our proposed imaging simulation method significantly reduces the cost of training the post-processing network while enhancing the imaging quality. Extensive experiments demonstrate the accuracy of our proposed method and the superiority of our synthetic dataset. (c) 2024 Optica Publishing Group
Time-delay compensation for stabilization imaging system

yueting chen,zhihai xu,qi li,huajun feng

DOI: https://doi.org/10.1117/12.2051893

2014-01-01

Abstract:The spatial resolution of imaging systems for airborne and space-borne remote sensing are often limited by image degradation resulting from mechanical vibrations of platforms during image exposure. A straightforward way to overcome this problem is to actively stabilize the optical axis or drive the focal plane synchronous to the motion image during exposure. Thus stabilization imaging system usually consists of digital image motion estimation and micro-mechanical compensation. The performance of such kind of visual servo system is closely related to precision of motion estimation and time delay. Large time delay results in larger phase delay between motion estimation and micro-mechanical compensation, and leads to larger uncompensated residual motion and limited bandwidth. The paper analyzes the time delay caused by image acquisition period and introduces a time delay compensation method based on SVM (Support Vector Machine) motion prediction. The main idea to cancel the time delay is to predict the current image motion from delayed measurements. A support vector machine based method is designed to predict the image motion. A prototype of stabilization imaging system has been implemented in the lab. To analyze the influences of time delay on system performance and to verify the proposed time delay cancelation method, comparative experiments over various frequencies of vibration are taken. The experimental results show that, the accuracy of motion compensation and the bandwidth of the system can be significantly improved with time delay cancelation.
Real-time Video Stabilization Based on Minimal Spanning Tree and Modified Kalman Filter

Xie Ya-jin,Xu Zhi-hai,Feng Hua-jun,Li Qi,Chen Yue-ting

DOI: https://doi.org/10.3788/gzxb20184701.0110002

2018-01-01

Abstract:To solve the inaccurate problem of global motion estimation due to local motion in video stabilization, a real-time stabilization method was proposed. The method proposes an approach of feature points iterative filtering algorithm based on minimal spanning tree and applies spanning tree similarity of successive frames to measure feature matching and discard wrong matched points and points in moving foreground. Then, an adaptive weighted method was applied to correct the transformation matrix to solve the wobble problem due to few feature points caused by foreground occlusion. Finally, an modified dual Kalman filters based on motion queue was proposed to correct measurement noise covariance adaptively and adjust smoothers of filter dynamically. It can process videos with intended camera motion and random jitters effectively. Experimental results show that the proposed method can perform well even in situation of local foreground motion and intended camera motion. Under circumstance of Intel Core i5 3.30 GHz CPU, the proposed method can stabilize videos of 640 X 360 resolution at a rate of 40FPS. And it has real-time advantage since next frame information is not needed during computation.
A Real-Time Digital Image Stabilization Algorithm on Pc

Y Sun,YJ Zhao,YB Zhou,MQ Liu,H Lu,F Yu

DOI: https://doi.org/10.1117/12.481639

2002-01-01

Abstract:This paper presents a real-time digital image stabilization algorithm on PC to stabilize a sequence of images. The proposed algorithm can be divided into 3 steps. First step is to acquire an appropriate bit plane. It is easier and faster to compute with bit plane than original image. Second, through histogram processing, we can match cursorily. lfthere are error matches, we can use a block matching algorithm to match again to acquire exact result. Then the local motion vector can be obtained from it. If we apply inline MMX assemble language hybrid programming, we can make it faster on PC. Last, we eliminate the field motion vector produced in irregular conditions. Through this step, we can void local motion vectors affected by undesirable condition such as moving objects. The characteristic of this algorithm is fast and effective. By it, real-time digital image stabilization can be realized on PC.
Realization of an Electronic Image Stabilization Algorithm Based on TMS320C642

Zhang Cui,Wu Cheng,Zheng Sheng,Fang Wanli,Feng Saisai

DOI: https://doi.org/10.16180/j.cnki.issn1007-7820.2011.04.034

2011-01-01

Abstract:This article describes a method for electronic image stabilization to solve the problem of the dithering video image.This system uses the projection algorithm and the fixed-point digital signal processor chips TMS320DM642 made by Texas Instruments to achieve image stabilization.The basic requirements of electronic image stabilization performance is introduced.The basic principles of image stabilization is presented.According to the requests,the image stabilization algorithm is selected to design the hardware block diagram of the system.Simulation shows that the algorithm has good performance and can meet the requirement for accuracy.
An Overview of Video Stabilization

CHEN Qili,SONG Li,YU Songyu

DOI: https://doi.org/10.3969/j.issn.1002-8692.2011.07.005

2011-01-01

Abstract:Different video stabilization algorithms are analyzed in this paper, including motion-based algorithms under the classical stabilization framework and the novel non-motion algorithms. The applicability and features of the algorithms are also presented. At the end, the existing problems and future prospects are pointed out.

Summarization of Electronic Image Stabilization

Image Stabilization Using Motion Estimation and Micro-mechanical Compensation

Real-time Digital Image Stabilization Method Based on Projection Algorithm and Block Matching

Performance test of optical and electronic image stabilizer for digital imaging system

Image Stabilization with Support Vector Machine

Real-Time Digital Image Stabilization System Based on Gray Projection Algorithm

Interline image revision method for electrical image stabilization

A Fast Approach Against Large Foreground Motion in Real-time Image Stabilization

Video stabilization algorithm based on human visual characteristics

Study on Performance Evaluation and Frequency Characteristic for Real-Time Image Stabilization System

Video stabilisation based on modelling of motion imaging.

An Approach of Electronic Image Stabilization Based on the Representative Point Matching

A Fast Digital Image Stabilization Algorithm Based on Multiple-candidate Three-step Search

Optimization Technique of Electronic Image Stabilization Based on Feature Matching

A Circular-Projection based digital image stabilization algorithm and its implementation for rotating image sequences

Imaging Simulation and Restoration for Mobile-based Long-focus Camera with Optical Stabilization

Time-delay compensation for stabilization imaging system

Real-time Video Stabilization Based on Minimal Spanning Tree and Modified Kalman Filter

A Real-Time Digital Image Stabilization Algorithm on Pc

Realization of an Electronic Image Stabilization Algorithm Based on TMS320C642

An Overview of Video Stabilization