Abstract:Correspondence matching plays a crucial role in numerous robotics applications. In comparison to conventional hand-crafted methods and recent data-driven approaches, there is significant interest in plug-and-play algorithms that make full use of pre-trained backbone networks for multi-scale feature extraction and leverage hierarchical refinement strategies to generate matched correspondences. The primary focus of this paper is to address the limitations of deep feature matching (DFM), a state-of-the-art (SoTA) plug-and-play correspondence matching approach. First, we eliminate the pre-defined threshold employed in the hierarchical refinement process of DFM by leveraging a more flexible nearest neighbor search strategy, thereby preventing the exclusion of repetitive yet valid matches during the early stages. Our second technical contribution is the integration of a patch descriptor, which extends the applicability of DFM to accommodate a wide range of backbone networks pre-trained across diverse computer vision tasks, including image classification, semantic segmentation, and stereo matching. Taking into account the practical applicability of our method in real-world robotics applications, we also propose a novel patch descriptor distillation strategy to further reduce the computational complexity of correspondence matching. Extensive experiments conducted on three public datasets demonstrate the superior performance of our proposed method. Specifically, it achieves an overall performance in terms of mean matching accuracy of 0.68, 0.92, and 0.95 with respect to the tolerances of 1, 3, and 5 pixels, respectively, on the HPatches dataset, outperforming all other SoTA algorithms. Our source code, demo video, and supplement are publicly available at <a class="link-external link-http" href="http://mias.group/GCM" rel="external noopener nofollow">this http URL</a>.

Dense correspondence through descriptor matching

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

A More Robust Feature Correspondence for more Accurate Image Recognition

Efficient Covisibility-based Image Matching for Large-Scale SfM

Dense Correspondence Using Non-Local DAISY Forest

Exploiting Feature Correspondence Constraints for Image Recognition

A Branch-and-Bound Approach to Correspondence and Grouping Problems

Unsupervised Feature Learning for Dense Correspondences Across Scenes

Face recognition via fast dense correspondence

A Dense Optical Flow-Based Feature Matching Approach in Visual Odometry

A unified feature-spatial cycle consistency fusion framework for robust image matching

A Surface Approximation Method for Image and Video Correspondences

Dense correspondence of deformable volumetric images via deep spectral embedding and descriptor learning

A2B: Anchor to Barycentric Coordinate for Robust Correspondence

Generalized Correspondence Matching via Flexible Hierarchical Refinement and Patch Descriptor Distillation

Robust Frame-to-Frame Hybrid Matching

<Bold>Matching Images More Efficiently With Local Descriptors</Bold>

Semantic Correspondence as an Optimal Transport Problem

Learning Compact Feature Descriptor and Adaptive Matching Framework for Face Recognition

Descriptor Ensemble: An Unsupervised Approach to Descriptor Fusion in the Homography Space