Abstract:Local feature matching involves establishing accurate pixel-wise correspondences between an image pair, which is a critical component in several visual applications (e.g., visual localization). Recently, detector-free techniques have realized excellent performance in this task. However, existing methods tend to focus on the entire image without prioritizing overlapping regions, resulting in undesirable interference from non-overlapping areas during the descriptors enhancement process. Moreover, these approaches neglect unreliable ground-truth matching labels triggered by measurement noise in datasets, leading to sub-optimal network optimization. In this study, we develop a novel overlapping areas-based network OAMatcher to resolve these issues. For the first issue, OAMatcher employs an overlapping regions perception block (ORPB) that captures the overlapping areas of image pairs to filter out plentiful mismatches and circumvent interference from non-overlapping regions during descriptors enhancement process. Specifically, the ORPB first enhances the descriptors of all keypoints to mimic the human behaviour of scrutinizing entire images back and forth at the start of feature matching. Subsequently, the ORPB introduces an overlapping regions extraction block (OREB) that captures the keypoints within overlapping zones to mimic the humans behaviour of shifting the focus from the whole images to co-visible areas. After OREB, ORPB performs descriptors enhancement exclusively among the keypoints within these co-visible regions, ensuring minimal disturbances from non-overlapping areas. In addition, the ORPB confines the predicted matches strictly to co-visible regions, thus efficiently filtering out a significant number of mismatches in non-overlapping zones. For the second issue, OAMatcher proposes a labels weighting algorithm (LWA) that predicts the label credibility for ground-truth matching labels. LWA assigns low credibility to unreliable labels and utilizes the credibility to weight loss, effectively diminishing the influence of unreliable labels. Extensive experiments show that OAMatcher delivers excellent results for homography estimation, pose estimation, and visual localization tasks.

Local-adaptive and Outlier-Tolerant Image Alignment Using RBF Approximation.

Accurate Range Image Registration: Eliminating or Modelling Outliers

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Objective Quality Assessment of Retargeted Images Based on RBF Neural Network with Structural Distortion and Content Change

Deterministic Optimality for Robust Vehicle Localization Using Visual Measurements

An Accurate and Robust Registration Framework Based on Outlier Removal and Feature Point Adjustment for Remote Sensing Images

A High Precision Feature Matching Method Based On Geometrical Outlier Removal For Remote Sensing Image Registration

A Novel Image Registration Method Based on Geometrical Outlier Removal

Automatic Registration of Images with Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal

RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images.

Image Alignment by Online Robust PCA Via Stochastic Gradient Descent

Robust Feature Matching for Remote Sensing Image Registration Via Locally Linear Transforming

Batch Image Alignment Via Subspace Recovery Based on Alternative Sparsity Pursuit

Robust feature matching using guided local outlier factor

Efficient Algorithms for Global Outlier Removal in Large-scale Structure-from-Motion

Accurate Image Alignment Based on Multi-Warp Optimization for Large Parallax

Iterative Online Subspace Learning for Robust Image Alignment

Robust Outlier Rejection for 3D Registration with Variational Bayes

Robust Alignment for Panoramic Stitching via an Exact Rank Constraint

Find Outliers of Image Edge Consistency by Weighted Local Linear Regression with Equality Constraints

OAMatcher: an Overlapping Areas-Based Network with Label Credibility for Robust and Accurate Feature Matching