An image matching optimization algorithm based on pixel shift clustering RANSAC

Shuhua Ma,Peikai Guo,Hairong You,Ping He,Guanglin Li,Heng Li

DOI: https://doi.org/10.1016/j.ins.2021.03.023

IF: 8.1

2021-07-01

Information Sciences

Abstract:<p>This paper focuses on improving the accuracy of image matching by eliminating the residual mismatches in the matching results of standard RANSAC. Based on pixel shift clustering and RANSAC algorithms, a matching optimization algorithm called pixel shift clustering RANSAC, PSC-RANSAC in short, is proposed in this paper.Firstly, the pixel shift model of space point from two perspectives are established by parallax principle and camera projection model. Then, based on the established pixel shift model, density peaks clustering (DPC) algorithm is used to select the mismatches out to enhance the accuracy of image matching. Meanwhile the comparisons among PSC-RANSAC, standard RANSAC, progressive sample consensus and graph-cut RANSAC show that PSC-RANSAC can more effectively and robustly eliminate the residual mismatches in initial matching results. The proposed method provides an effective tool for optimization on image matching.</p>

computer science, information systems

What problem does this paper attempt to address?

The main purpose of this paper is to propose a new image matching optimization algorithm to improve the accuracy of image matching. Specifically, the authors address the issue where the standard RANSAC algorithm fails to effectively remove all mismatches in certain situations, by proposing the Pixel Shift Clustering RANSAC (PSC-RANSAC) algorithm.

### Main Contributions:
1. **Secondary Filtering Strategy**: By adopting a secondary filtering method to handle residual mismatches in the standard RANSAC matching results, high-precision matching results can be obtained even when the matching constraint model fails, thereby increasing the robustness of the image matching algorithm.
2. **Pixel Shift Model**: A pixel shift model for feature points under different motion patterns is established, and the Density Peaks Clustering (DPC) algorithm is used to filter out mismatches, effectively improving the accuracy of image matching.
3. **Experimental Validation**: The PSC-RANSAC was tested on image datasets recorded in the laboratory and compared with related works. The results show that the proposed algorithm performs well in terms of matching accuracy and robustness.

### Method Overview:
- **Establishing the Pixel Shift Model**: Using the principle of parallax and the camera projection model, a pixel shift model of spatial points from two perspectives is established.
- **Applying the Density Peaks Clustering Algorithm**: Based on the established pixel shift model, the Density Peaks Clustering (DPC) algorithm is used to select mismatches.
- **Comparative Experiments**: PSC-RANSAC is compared with standard RANSAC, Progressive Sample Consensus (PROSAC), and Graph-Cut RANSAC to verify that PSC-RANSAC can more effectively eliminate residual mismatches in the initial matching results.

### Conclusion:
This paper proposes a new image matching optimization algorithm, PSC-RANSAC, which can significantly improve the accuracy and robustness of image matching, providing an effective tool for image matching.