Robust Image Matching Via Local Graph Structure Consensus

Xingyu Jiang,Yifan Xia,Xiao-Ping Zhang,Jiayi Ma

DOI: https://doi.org/10.1016/j.patcog.2022.108588

IF: 8

2022-01-01

Pattern Recognition

Abstract:Image matching plays a vital role in many computer vision tasks, and this paper focuses on the mis-match removal problem of feature-based matching. We formulate the problem into a general yet effec-tive optimization framework based on graph matching by combining integer quadratic programming with a compensation term for discouraging matches, termed as Local Graph Structure Consensus (LGSC). Con -sidering the local area similarity of those potential true matches, we design a local graph structure for preserving geometric topology, which contains a local indicator vector and a local affinity vector for each correspondence. The local indicator vector is utilized for edge construction, while the local affinity vector represents the match correctness of the nodes and edges between two graphs. In particular, the ranking shift with scale and rotation invariance is exploited to represent the node affinity. Ultimately, we derive a closed-form solution with linearithmic time and linear space complexity. Moreover, a multi-scale and iterative graph construction strategy is proposed to promote the performance of our method in terms of robustness and effectiveness. Extensive experiments on various real image datasets demonstrate that our LGSC can achieve superior performance over current state-of-the-art approaches. (c) 2022 Elsevier Ltd. All rights reserved.