A New Global Registration Algorithm For Image Mosaic

Fuli Wu,Xianyong Fang

2007-01-01

Abstract:In this paper, we proposed a new bundle adjustment algorithm based on the distance minimization of feature matches, to eliminate the accumulated errors over a sequence for seamless mosaic. The new feature based image mosaic approach improved the stability of the global registration. among images. Our experiments show that the new mosaic method is robust.

What problem does this paper attempt to address?

An optimization method for registration and mosaicking of remote sensing images

Jinwei Chen,Huajun Feng,Kecheng Pan,Zhihai Xu,Qi Li

DOI: https://doi.org/10.1016/j.ijleo.2013.07.034

IF: 3.1

2014-01-01

Optik

Abstract:An optimization method for registration and mosaicking of remote sensing images has been proposed. More than four pairs of control points extracted by scale invariant feature transform (SIFT) detector have been used to obtain the projective transformation relation between the reference image and text image. A method based on gradient information of the region has been proposed to assign the weighted value to the feature points. The weighted value reflects the importance of the area, which can change the result of optimization. The combination method of seam cutting and feathering technique is used to stitch two overlapped images. Our experiment shows that the alignment error of interest area is smaller than that of normal area. If the weighted parameter is given proper value, the alignment error of interest area can reduced to less than one pixel.
An Improved Framework for Automatic Image Mosaic

Jie Lei,Jingting Ding,Jilin Liu

DOI: https://doi.org/10.1117/12.838410

2010-01-01

Abstract:This paper describes an improved framework to generate seamless image mosaic automatically. The input images are classified into different image connectivity sets by using speeded features. For each set, the proposed method includes two parts: initial alignment and global optimization. The initial geometrical registration is obtained using the classical parameterization of homography. The photometric parameters among images are computed to balance the overall gain using the least square method. A good global optimization can be achieved with these initial information and multiple constraints between images. Besides, we also take the radial distortion into consideration. Mulitresolution blending combined with an optimal seam selection gives the final seamless mosaic. Various image sets illustrate the robustness of the proposed method in experimental results.
Robust image mosaic with RANSAC and bundle adjustment

Xianyong Fang,Zhigeng Pan,Bin Luo,Fuli Wu,Sanhua Guo

2008-01-01

Journal of Computational Information Systems

Abstract:A new feature based image mosaic method is presented in this paper. Our contributions can be generalized into two aspects: an improved RANSAC homography algorithm based on the modified media flow filter, to detect wrong matches for improving the stability of the normal RANSAC homography algorithm; and a new bundle adjustment algorithm based on the distance minimization of feature matches, to eliminate the accumulated errors over a sequence for seamless mosaic. Experiments show that our mosaic method is robust.
Automatic image mosaic

T. Bo,Yao ZhiWei,Zheng Xiaoxiang

1997-01-01

Abstract:This paper presents a new method for image mosaic. Analysis of characteristics of mosaic showed that the registration should be completed as follows. (1) To overcome disturbance and to remove mismatch, a preprocessing for clearing and normalizing subpictures should be required. (2) Fast registration algorithm based on self-learning threshold is suitable for registration of a large number of images. (3) To determine the position of each subpicture in a mosaic picture by clique growth. (4) To eliminate gradient in mosaic image by adjustment of gray average weighted with distance. The merit of this method is that mosaic of multiple images is completed by computer automatically and human bias factors are avoided. The operation is fast and precise. It can also assemble pictures smoothly which is not available by manual method. | Analysis of characteristics of mosaic showed that the registration should be completed as follows. (1) to overcome disturbance and to remove mismatch, a preprocessing for clearing and normalizing subpictures being required. 92) fast registration algorithm based on self learning threshold being suitable for registration of a number of images; (3) to determine the position of each subpicture in a mosaic picture by clique growth; (4) to eliminate gradient in mosaic image by adjustment of gray average weighted with distance. The merit of this method was that mosaic of multiple images being completed by computer automatically and human bias factors are avoided. The operation was fast and precise. It can also assemble pictures smoothly which was unavailable by manual method.
An Improved RANSAC Homography Algorithm for Feature Based Image Mosaic

Fuli Wu,Xianyong Fang

2007-01-01

Abstract:In this paper, we proposed a new feature based image mosaic algorithm. The improved RANSAC homography algorithm based on the modified media flow filter, to detect wrong matches for improving the stability of the normal RANSAC homography algorithm. The method improved the local registration between neighboring images. Experiments and Statistical Analysis show that our mosaic method is robust.
A NEW METHOD OF FEATURE BASED IMAGE MOSAIC

Xianyong Fang,Zhigeng Pan,Gaoqi He,Li

DOI: https://doi.org/10.1142/s0219467806002380

2006-01-01

International Journal of Image and Graphics

Abstract:A new feature based image mosaic method is presented in this paper. Our main contribution is an improved RANSAC algorithm based on the modified median flow filter to find the inliers and the homography between the images. This algorithm overcomes the limit of local feature detection and thus improves the stability of homography calculation. Except for the RANSAC algorithm, PCA-SIFT is used to detect features because it is more compact, more robust and faster than the standard SIFT. The priority search is also used to match the feature points in a faster way than BBF search. Experiments show that our method is robust for image mosaic.
Feature-based image registration and mosaicing

Weilin Song,Han Wang

DOI: https://doi.org/10.1117/12.389349

2000-06-23

Abstract:The technique of image mosaicing was analyzed in this paper. The progress of image mosaicing comprises two parts, namely image registration and image blending. The key issue of image mosacing is to calculate the transformations (Homography) from the input image pairs correctly and accurately. Feature based methods are adopted for image registration. Firstly, corners are extracted from the images to be glued together. Matches were found from these features manually. During the process of mosaicing, three different algorithms have been investigated including (1) the four-point algorithm, (2) the least square algorithm and (3) the unbiased least square algorithm which appliced Kanatani's statistical optimization theory. Experimental results show the effectiveness of the unbiased least square algorithm.

Engineering
A 5-Parameter Bundle Adjustment Method for Image Mosaic

Xianyong Fang,Bin Luo,Haifeng Zhao,Yiwen Zhang

DOI: https://doi.org/10.1109/icis.2009.27

2009-01-01

Abstract:A 5-parameter bundle adjustment method is proposed in this paper for global mosaic of an image sequence. By decomposing the rotation matrix into a 3-parameter rotation axis and a rotation angle, to each image, there are 5 parameters that need estimate for rotation axis, rotation angle and focal length. The proposed method minimizes the distance between feature matches in 3D space so that these 5 parameters are refined gradually for final stitching of all images together. Experimental results suggest that this method is an useful extension to existing research with the advantages of real 3D camera motion, accurate 5-parameter rotation decomposition and reliable 3D feature definition.
A Robust Image Mosaics Algorithm

ZHANG Hua,SUN Ji-zhou,YOU De-xiang

DOI: https://doi.org/10.3969/j.issn.1673-095x.2008.01.014

2008-01-01

Abstract:The key problem of image mosaics is the image registration.A robust registration method is investigated in this paper.It uses Harris-based corner detection algorithm to obtain feature points,then an improvement for image entropy is made using a Euclid weighted function so as to get accurate point matches.The least median square method is employed to obtain 8 parameters of transform matrix for image stitching.The experiment shows that the proposed algorithm can get good effects in high precision matching.
Improved image mosaic algorithm based on morphological method

Cai Zheng,Wang Yuanyuan,Wang Weiqi

DOI: https://doi.org/10.3321/j.issn:0254-3087.2006.z1.280

2006-01-01

Abstract:In order to achieve seamless mosaic image with both shape and exposal differences,an improved image mosaic algorithm is proposed based on the morphological method.In this algorithm,the image fusion is applied on the overlapping region of registered images.Firstly,the histogram matching method is used to generate two other images with the histograms in accordance with each other.A level-set approach to image blending is then applied to obtain blended images under two different exposure amounts.The final mosaic image is attained by stitching these two blended images using a combined algorithm of multi-resolution mosaic approach and the optimal seam line searching method based on the dynamic programming.With simulating mosaic experiments on both synthetic images and standard digital images,this algorithm is proved to be capable of achieving smooth transition between images with both shape and exposal differences.
New Multi-Resolution Image Stitching with Local and Global Alignment

X. Fang,B. Luo,H. Zhao,J. Tang,S. Zhai

DOI: https://doi.org/10.1049/iet-cvi.2009.0025

IF: 1.484

2010-01-01

IET Computer Vision

Abstract:Three main problems affect the alignment quality of existing studies on multi-resolution image stitching: (i) the initial motion obtained is sometimes incorrect; (ii) the local motion is hard to be estimated and (iii) the widely used global bundle adjustment is difficult to converge. The authors propose a new multi-resolution image mosaic method that combines three corresponding tactics to solve these problems. The first problem is solved by introducing an additional motion refinement strategy, which consists of the low-contrast filter and RANSAC. The former removes flatly textured surface pixels and thus eliminates the falsely matched features. The latter removes outliers and finds a robust initial motion for the next layer. The second problem is resolved by a new iteratively local registration method, which calibrates the current camera parameters based on those from previous image with robust non-linear optimisation methods. It improves the convergence efficiency and eliminates error minimisation. For the last problem, the authors introduce a five-parameter bundle adjustment method based on the axis-angle decomposition of the rotation matrix. Comparing with existing bundle adjustment methods, this method is more stable because of an accurate and simple rotation decomposition. The authors show the efficiency of the method with qualitative and quantitative experiments.
A novel image mosaic method based on improved SIFT algorithm and Contourlet Transform

Cheng Cheng,Liling Ma,Yuanlong Yu,Junzheng Wang

2013-01-01

Abstract:The two key steps in image mosaic process are image registration and image fusion. The common SIFT algorithm needs complicated calculation, which wastes too much time in practical image registration. This problem is solved in this paper by giving the feature point in SIFT a more accurate main direction. Thus, the SIFT can be more easily used. Based on this improved SIFT algorithm, a new image mosaic method is proposed by combining it with the Contourlet Transform. An advantage of using Contourlet Transform in image fusion is that it can eliminate the color difference and make the merged picture clear. In this new method, the improved SIFT is used to do the registration work and the Contourlet Transform is adopted to merge the two images after registration. An experiment is also conducted in this paper to assess the stitching effect of the proposed method. The experiment result shows that this new method can accelerate the SIFT process in image registration and enhance the image mosaic effect.
Multi-images Mosaic Algorithm Based on Improved Phase Correlation and Feature Point Registration

Dan LI,Li-qing XIAO,Jun TIAN,Jin-ping SUN

DOI: https://doi.org/10.11896/j.issn.1002-137X.2018.01.054

2018-01-01

Abstract:The result of image mosaic suffers from different exposure of the camera,scale change,rotation,ambient noise and light interference.Manual sorting images have problems of high error rate and poor efficiency.In this paper,a new algorithm of multi-images mosaic based on improved phase correlation and feature point registration was proposed.Firstly,the improved phase correlation algorithm based on log polar transformation is used to calculate parameters of scaling,rotation and translation.Sort rules are made according to the peak size of impulse function energy.Then,the Harris comer points are extracted in overlapping positions,the matching point pairs are purified by the improved Ransac algorithm,and the transformation matrix is optimized to complete mosaic.At last,according to the phenomenon of joint,images are processed by NSCT transform algorithm to decompose low frequency and high frequency sub-bands.The new fusion strategy can make the image joint seem smooth and natural.The results of the experiments confirm that the model parameters established by the new algorithm are accurate and efficient,and the mosaic has high robustness to complex environment and chaotic sequence images.
Automatic Registration of Aerial Image Series Using Geometric Invariance

Li Lou,Fei-Meng Zhang,Chen Xu,Feng Li,Mo-Gen Xue

DOI: https://doi.org/10.1109/ical.2008.4636334

2008-01-01

Abstract:In this paper, a strong emphasis is laid on the study of automatic alignment and registration technology for the purpose of stitching serial images and getting a larger, seamless and high-resolution one. Aerial image taken by robot flying flat has low quality and complex distortion, it is hard to find and evaluate transformation factors in the scene which appeared between the aeronautic consecutive images for mosaicking. So the registration turns on the crucial step of successful image mosaic. Based on the FBM and ABM algorithm as the initial matching, a matching technique of epipolar geometric theory is introduced as the final one in the interest of attaining more precise aggregate of matching points. In order to accurately and robustly estimate the F-matrix (fundamental matrix) which encapsulated the whole epipolar geometry, an improved SVD decomposition with weighted normalized F-matrix calculating method is proposed. By using geometric invariant, cross ratio to rectify the matching points, the rectification is realized automatically and the coarse error is reduced effectively.
Image panoramic mosaicing with global and local registration

Qi Li,Z. Ji,Ji-hong Zhang

DOI: https://doi.org/10.1117/12.441528

2001-09-20

Abstract:This paper presents techniques for constructing full view panoramic mosaics from sequences of images. The goal of this work is to remove too many limitations for pure panning motion. The best reference block is critical for the block- matching method for improving the robustness and performance. It is automatically selected in the high- frequency image, which always contains the plenty visible features. In order to reduce accumulated registration errors, the global registration using the phase-correlation matching method with rotation adjustment is applied to the whole sequence of images, which results in an optimal image mosaic with resolving translational or rotational motion. The local registration using the Levenberg-Marquardt iterative non-linear minimization algorithm is applied to compensate for small amounts of motion parallax introduced by translations of the camera and other unmodeled distortions, when minimize the discrepancy after applying the global registration. The accumulated misregistration errors may cause a visible gap between the two images. A smoothing filter is introduced, derived from Marr's computer vision theory for removing the visible artifact. By combining both global and local registration, together with artifact smoothing, the quality of the image mosaics is significantly improved, thereby enabling the creation of full view panoramic mosaics with hand-held cameras.

Engineering
An Improved Algorithm for Image Mosaic

Hongyan Wen,Jianzhong Zhou

DOI: https://doi.org/10.1109/isise.2008.293

2009-01-01

Electronics Optics & Control

Abstract:This paper puts forward a novel method using dynamic programming and grey relational analysis to find a best seam line because of the grey scale difference in the edges of image in the overlapping region and the relation of neighboring points. The first step is to find an optimal seam line to stitch the images. Then the seam line is removed by a hard correction method based on dynamic width. Finally, the seamless mosaicking image is created. Three-kind different experimental results of regular texture images, irregular texture images and different temporal images indicate that the new method is very effective, simple, easy to realize and can gain more satisfying mosaicking images.
Registration Of Blurred Images For Image Mosaic

Xianyong Fang,Bin Luo,Jin Tang,Haifeng Zhao,Biao He,Hao Wu

DOI: https://doi.org/10.1109/CADCG.2009.5246906

2009-01-01

Abstract:Existing methods for the registration of blurred images are efficient for the artificially blurred images or a planar registration. They are not suitable for image mosaic of the source images from a real camera with an almost fixed optical center We propose a registration method so that a distortion-free registration on naturally captured images can be obtained. It adopts a multi-resolution and robust feature based inter-layer mosaic together In each layer Harris corner detector is chosen to effectively detect features and RANSAC is used to find reliable matches for further calibration as well as an initial homography as the initial motion of next layer Simplex and subspace trust region methods are used consequently to estimate the stable focal length and rotation matrix through the transformation property of feature matches. Experimental results demonstrate the performance of our proposed method.
Feature Based Multi-Resolution Registration of Blurred Images for Image Mosaic

Xianyong Fang,Bin Luo,Bin He,Hao Wu

2010-01-01

Abstract:Existing methods for the registration of blurred images are efficient for the artificially blurred images or a planar registration, but not suitable for the naturally blurred images existing in the real image mosaic process. In this paper, we attempt to resolve this problem and propose a method for a distortion-free stitching of naturally blurred images for image mosaic. It adopts a multi-resolution and robust feature based inter-layer mosaic together. In each layer, Harris corner detector is chosen to effectively detect features and RANSAC is used to find reliable matches for further calibration as well as an initial homography as the initial motion of next layer. Simplex and subspace trust region methods are used consequently to estimate the stable focal length and rotation matrix through the transformation property of feature matches. In order to stitch multiple images together, an iterative registration strategy is also adopted to estimate the focal length of each image. Experimental results demonstrate the performance of the proposed method.
An Improved UAV Aerial Image Mosaic Algorithm Based on GMS-RANSAC

Xiangyan Lan,Baolong Guo,Zhe Huang,Suting Zhang

DOI: https://doi.org/10.1109/icsip49896.2020.9339283

2020-01-01

Abstract:The aerial image mosaic algorithm needs to ensure the real-time performance of the algorithm and the natural transition of image fusion. In order to improve the matching performance of the algorithm, an improved UAV aerial image registration algorithm based on GMS-RANSAC is proposed. The improved algorithm introduces the idea of partitioning, divides the image into meshes and then performs feature extraction on each mesh, uses the bidirectional BF algorithm and the GMS algorithm to perform accurate feature value matching, and finally uses the improved RANSAC algorithm for further feature purification to obtain a high-quality correct interior point set. This paper combines the characteristics of GMS algorithm to improve the RANSAC algorithm, reduce the number of iterations of the algorithm, and reduce the time complexity of the algorithm. The improved image registration algorithm has higher accuracy and shorter running time. After the registration is completed, the image is merged to obtain a mosaic image.
A new algorithm of global feature matching based on triangle regions for image registration

Zhaoxia Liu,Jubai An

DOI: https://doi.org/10.1109/ICOSP.2010.5654963

IF: 4.729

2010-01-01

Signal Processing

Abstract:Feature matching is a crucial and challenging process in feature-based image registration. Mismatch is always inevitable in image registration for the feature matching methods that just use local features, no matter how powerful the discrimination of the feature point descriptor is. To solve this problem, in this paper, relative moment affine invariants are used to compare the similarity of two triangles, then a new global feature matching method is proposed to match the feature points accurately based on graph structure. In the point matching process, Genetic Algorithm is applied to find two most similar graphs that are constructed by the corresponding survivor points from two images. The proposed algorithm can deal with images of affine transformation, large scale and low overlap. Compared with traditional Iterative Closest Point (ICP), normalized cross-correlation (NCC) and Coherent Point Drift (CPD), which register aerial images captured on the sea, the proposed algorithm works well with high accuracy and stability even when the point sets have a lot of outliers.

A New Global Registration Algorithm For Image Mosaic

An optimization method for registration and mosaicking of remote sensing images

An Improved Framework for Automatic Image Mosaic

Robust image mosaic with RANSAC and bundle adjustment

Automatic image mosaic

An Improved RANSAC Homography Algorithm for Feature Based Image Mosaic

A NEW METHOD OF FEATURE BASED IMAGE MOSAIC

Feature-based image registration and mosaicing

A 5-Parameter Bundle Adjustment Method for Image Mosaic

A Robust Image Mosaics Algorithm

Improved image mosaic algorithm based on morphological method

New Multi-Resolution Image Stitching with Local and Global Alignment

A novel image mosaic method based on improved SIFT algorithm and Contourlet Transform

Multi-images Mosaic Algorithm Based on Improved Phase Correlation and Feature Point Registration

Automatic Registration of Aerial Image Series Using Geometric Invariance

Image panoramic mosaicing with global and local registration

An Improved Algorithm for Image Mosaic

Registration Of Blurred Images For Image Mosaic

Feature Based Multi-Resolution Registration of Blurred Images for Image Mosaic

An Improved UAV Aerial Image Mosaic Algorithm Based on GMS-RANSAC

A new algorithm of global feature matching based on triangle regions for image registration