Abstract:In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or outliers, in addition to a limited number of true correspondences (inliers). Next, we solve for correspondence by interpolating a vector field between the two point sets, which involves estimating a consensus of inlier points whose matching follows a nonparametric geometrical constraint. We formulate this a maximum a posteriori (MAP) estimation of a Bayesian model with hidden/latent variables indicating whether matches in the putative set are outliers or inliers. We impose nonparametric geometrical constraints on the correspondence, as a prior distribution, using Tikhonov regularizers in a reproducing kernel Hilbert space. MAP estimation is performed by the EM algorithm which by also estimating the variance of the prior model (initialized to a large value) is able to obtain good estimates very quickly (e.g., avoiding many of the local minima inherent in this formulation). We illustrate this method on data sets in 2D and 3D and demonstrate that it is robust to a very large number of outliers (even up to 90%). We also show that in the special case where there is an underlying parametric geometrical model (e.g., the epipolar line constraint) that we obtain better results than standard alternatives like RANSAC if a large number of outliers are present. This suggests a two-stage strategy, where we use our nonparametric model to reduce the size of the putative set and then apply a parametric variant of our approach to estimate the geometric parameters. Our algorithm is computationally efficient and we provide code for others to use it. In addition, our approach is general and can be applied to other problems, such as learning with a badly corrupted training data set.

Image Feature Matching via Progressive Vector Field Consensus

Robust Image Feature Matching Via Progressive Sparse Spatial Consensus

Real-time and High Precision Feature Matching Between Blur Aerial Images

Progressive Feature Matching Via Triplet Graph

Efficient Covisibility-based Image Matching for Large-Scale SfM

Robust Point Matching via Vector Field Consensus

TOCSAC: TOpology Constraint SAmple Consensus for Fast and Reliable Feature Correspondence

Progressive Motion Coherence for Remote Sensing Image Matching

Robust Feature Matching Via Advanced Neighborhood Topology Consensus

Feature Point Matching Algorithm Based on Local Relative Velocity Consensus

Robust Feature Matching Via Graph Neighborhood Motion Consensus

An Ensemble Method for Accurate Image Matching

Fast and Adaptive Local Consensus Verification for Robust Feature Correspondence

Robust Feature Matching for 3D Point Clouds with Progressive Consistency Voting

Aerial image matching based on dynamic convolution and adaptive neighborhood consensus network

Extended Neighborhood Consensus With Affine Correspondence for Outlier Filtering in Feature Matching

Image Feature Correspondence Selection: A Comparative Study and a New Contribution

Zero-Shot Image Feature Consensus with Deep Functional Maps

Feature Matching for Remote-Sensing Image Registration via Neighborhood Topological and Affine Consistency

Robust Image Matching Via Local Graph Structure Consensus

An Image Matching Algorithm Based On Singular Value Decomposition and Belief Propagation