Least Squares Matching Methods for Wide Base-line Stereo Images Based on SIFT Features

YANG Huachao,ZHANG Shubi,ZHANG Qiuzhao
2010-01-01
Abstract:Some new feature extraction and matching algorithms(especially the Scale Invariant Feature Transformation algorithm,SIFT) that are invariant to translation,scale and rotation changes have been widely used in digital photogrammetry and computer vision fields.However,SIFT features are not invariant to affine deformation,and the location precision may be low because the feature extraction and matching are independent.In practical applications,this disadvantage makes it not appropriate for wide base line stereo matching.In order to solve this problem and to make it invariant to affine transformation,a new SIFT features' matching algorithm based on duplicate constraints and least squares image matching method was proposed in this paper.In this algorithm,the optimal SIFT features with good spatial distribution and large information content was first selected,then these SIFT features was matched by using SVD-SIFT algorithm and adaptive NCC matching method based on scale and orientation information of SIFT features.The fundamental and homography matrix can be estimated by using these initial correspondences.Other SIFT features were matched by using duplicate geometric constraint and weighted least squares matching with multiple scale template window.At the same time,the least squares matching results were selected accordingly.Further,compared to the location error of the original SIFT key points,least squares matching results were determined to adopted or not.Last,two wide base line image sequences were selected to test the performance of proposed algorithm.Test results indicate that the proposed method has higher performance than the original SIFT methods and the SVD based SIFT methods when no significant illumination changes between stereo image pairs.
What problem does this paper attempt to address?