Learning to find reliable correspondences with local neighborhood consensus
Yang Wang,Xiaoguang Mei,Yong Ma,Jun Huang,Fan Fan,Jiayi Ma
DOI: https://doi.org/10.1016/j.neucom.2020.04.016
IF: 6
2020-09-01
Neurocomputing
Abstract:<p>Seeking reliable correspondences has been always the key of achieving image matching task in computer vision. The recent work LFGC aims to achieve this goal by training a binary correspondence classifier, which infers the probabilities of correspondences being inliers and regresses the relative camera pose via learning the input correspondence data. Specially, the LFGC employs multi-layer perceptrons to extract features and context normalization to model underlying contextual relation of correspondences. Nevertheless, the contextual relation obtained by context normalization is easily interfered by outliers, which limits the accuracy and robustness of the correspondence classifier. To address this limitation, based on the observation that the contextual relation in spatial neighborhood is generally well preserved on most scenarios, this paper proposes an improved strategy, <em>i.e.</em>, maximizing local neighborhood consensus to establish robust neighborhood context. Specifically, we construct the neighborhood for correspondences and preserve neighbors' features similar to their medoids, where the neighborhood information is embedded. Subsequently, we combine this neighborhood structure with multi-layer perceptrons to classify the correspondences as inliers or outliers, simultaneously potential inliers are employed to regress the relative camera pose encoded by the essential matrix. Qualitative and quantitative experimental results on benchmark datasets demonstrate that the improved network can effectively promote performance in outlier removal and camera pose estimation comparing with the baseline.</p>
computer science, artificial intelligence