Abstract:Local feature matching involves establishing accurate pixel-wise correspondences between an image pair, which is a critical component in several visual applications (e.g., visual localization). Recently, detector-free techniques have realized excellent performance in this task. However, existing methods tend to focus on the entire image without prioritizing overlapping regions, resulting in undesirable interference from non-overlapping areas during the descriptors enhancement process. Moreover, these approaches neglect unreliable ground-truth matching labels triggered by measurement noise in datasets, leading to sub-optimal network optimization. In this study, we develop a novel overlapping areas-based network OAMatcher to resolve these issues. For the first issue, OAMatcher employs an overlapping regions perception block (ORPB) that captures the overlapping areas of image pairs to filter out plentiful mismatches and circumvent interference from non-overlapping regions during descriptors enhancement process. Specifically, the ORPB first enhances the descriptors of all keypoints to mimic the human behaviour of scrutinizing entire images back and forth at the start of feature matching. Subsequently, the ORPB introduces an overlapping regions extraction block (OREB) that captures the keypoints within overlapping zones to mimic the humans behaviour of shifting the focus from the whole images to co-visible areas. After OREB, ORPB performs descriptors enhancement exclusively among the keypoints within these co-visible regions, ensuring minimal disturbances from non-overlapping areas. In addition, the ORPB confines the predicted matches strictly to co-visible regions, thus efficiently filtering out a significant number of mismatches in non-overlapping zones. For the second issue, OAMatcher proposes a labels weighting algorithm (LWA) that predicts the label credibility for ground-truth matching labels. LWA assigns low credibility to unreliable labels and utilizes the credibility to weight loss, effectively diminishing the influence of unreliable labels. Extensive experiments show that OAMatcher delivers excellent results for homography estimation, pose estimation, and visual localization tasks.

Robust image matching via ORB feature and VFC for mismatch removal

SORB: Improve ORB Feature Matching by Semantic Segmentation

Image Matching Algorithm based on ORB and K-Means Clustering

Overview of Image Matching Based on ORB Algorithm

Robust Image Matching with Cascaded Outliers Removal

ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction

OAMatcher: an Overlapping Areas-Based Network with Label Credibility for Robust and Accurate Feature Matching

A High-Efficiency FPGA-Based ORB Feature Matching System

ORB-based Template Matching Through Convolutional Features Map

An Improved ORB-GMS Image Feature Extraction and Matching Algorithm*

A Robust Mismatch Removal Method for Image Matching Based on the Fusion of the Local Features and the Depth

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

Robust Image Matching Based on the Information of SIFT

A ROBUST METHOD FOR STEREO VISUAL ODOMETRY BASED ON MULTIPLE EUCLIDEAN DISTANCE CONSTRAINT AND RANSAC ALGORITHM

Fast and Robust Matching for Multimodal Remote Sensing Image Registration

An Improved ORB Feature Point Matching Algorithm

ORB Removal Mis-Matching Method Based on Mask R-CNN

A Mismatch Removal Method Based on Global Constraint and Local Geometry Preservation for Lunar Orbiter Images

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Robust feature matching using guided local outlier factor

ALGD-ORB: An improved image feature extraction algorithm with adaptive threshold and local gray difference