Binocular Visual Measurement Method Based on Feature Matching

Zhongyang Xie,Chengyu Yang
DOI: https://doi.org/10.3390/s24061807
IF: 3.9
2024-03-12
Sensors
Abstract:To address the issues of low measurement accuracy and unstable results when using binocular cameras to detect objects with sparse surface textures, weak surface textures, occluded surfaces, low-contrast surfaces, and surfaces with intense lighting variations, a three-dimensional measurement method based on an improved feature matching algorithm is proposed. Initially, features are extracted from the left and right images obtained by the binocular camera. The extracted feature points serve as seed points, and a one-dimensional search space is established accurately based on the disparity continuity and epipolar constraints. The optimal search range and seed point quantity are obtained using the particle swarm optimization algorithm. The zero-mean normalized cross-correlation coefficient is employed as a similarity measure function for region growing. Subsequently, the left and right images are matched based on the grayscale information of the feature regions, and seed point matching is performed within each matching region. Finally, the obtained matching pairs are used to calculate the three-dimensional information of the target object using the triangulation formula. The proposed algorithm significantly enhances matching accuracy while reducing algorithm complexity. Experimental results on the Middlebury dataset show an average relative error of 0.75% and an average measurement time of 0.82 s. The error matching rate of the proposed image matching algorithm is 2.02%, and the PSNR is 34 dB. The algorithm improves the measurement accuracy for objects with sparse or weak textures, demonstrating robustness against brightness variations and noise interference.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper aims to address the issue of low measurement accuracy and unstable results when using binocular cameras to detect surfaces with sparse textures, weak textures, occluded surfaces, low-contrast surfaces, and significant lighting changes. It proposes a 3D measurement method based on an improved feature matching algorithm to enhance the accuracy and robustness of binocular vision measurement systems. ### Specific Problems and Solutions 1. **Low Measurement Accuracy**: - When dealing with complex scenes, binocular cameras suffer from decreased measurement accuracy due to inaccurate feature point matching. - Solution: By combining feature points and feature regions, the improved feature matching algorithm is used to enhance matching accuracy. 2. **Unstable Results**: - Existing matching algorithms are prone to errors under lighting changes or noise interference, leading to unstable results. - Solution: The zero-mean normalized cross-correlation coefficient is used as the similarity measure function, and the particle swarm optimization algorithm is employed to determine the optimal search range and the number of seed points, thereby enhancing the robustness and anti-interference capability of the algorithm. 3. **Difficulty in Feature Matching**: - Traditional methods struggle to accurately match objects with sparse or weak textures. - Solution: The FAST feature point detection algorithm is used to extract feature points, followed by region growing to achieve matching between the left and right images. ### Main Contributions - A new 3D measurement method is proposed, combining the advantages of feature point matching and feature region matching, which improves matching accuracy and reduces algorithm complexity. - Experimental results show that the average relative error on the Middlebury dataset is 0.75%, the average measurement time is 0.82 seconds, the error matching rate is 2.02%, and the PSNR is 34 dB, demonstrating the effectiveness and robustness of the algorithm.