Abstract:In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or outliers, in addition to a limited number of true correspondences (inliers). Next, we solve for correspondence by interpolating a vector field between the two point sets, which involves estimating a consensus of inlier points whose matching follows a nonparametric geometrical constraint. We formulate this a maximum a posteriori (MAP) estimation of a Bayesian model with hidden/latent variables indicating whether matches in the putative set are outliers or inliers. We impose nonparametric geometrical constraints on the correspondence, as a prior distribution, using Tikhonov regularizers in a reproducing kernel Hilbert space. MAP estimation is performed by the EM algorithm which by also estimating the variance of the prior model (initialized to a large value) is able to obtain good estimates very quickly (e.g., avoiding many of the local minima inherent in this formulation). We illustrate this method on data sets in 2D and 3D and demonstrate that it is robust to a very large number of outliers (even up to 90%). We also show that in the special case where there is an underlying parametric geometrical model (e.g., the epipolar line constraint) that we obtain better results than standard alternatives like RANSAC if a large number of outliers are present. This suggests a two-stage strategy, where we use our nonparametric model to reduce the size of the putative set and then apply a parametric variant of our approach to estimate the geometric parameters. Our algorithm is computationally efficient and we provide code for others to use it. In addition, our approach is general and can be applied to other problems, such as learning with a badly corrupted training data set.

Robust Point Matching Using Mixture Of Asymmetric Gaussians For Nonrigid Transformation

Probabilistic Model for Robust Affine and Non-Rigid Point Set Matching

A Mixture Model for Robust Point Matching under Multi-Layer Motion

Robust Point Sets Matching by Fusing Feature and Spatial Information Using Nonuniform Gaussian Mixture Models.

Asymmetrical Gauss Mixture Models for Point Sets Matching

Robust Estimation of Nonrigid Transformation for Point Set Registration

A point matching algorithm based on Gaussian processes

Probabilistic Point Set Matching with Gaussian Mixture Model.

A Robust Point Sets Matching Method

Non-Rigid Point Set Registration Via Gaussians Mixture Model with Local Constraints

A Robust Non-Rigid Point Set Registration Method Based on Asymmetric Gaussian Representation.

Fuzzy Correspondences Guided Gaussian Mixture Model for Point Set Registration.

Robust Point Matching via Vector Field Consensus

Point Sets Matching by Feature-Aware Mixture Point Matching Algorithm.

Robust Point Set Matching under Variational Bayesian Framework

Robust Point Set Registration Method Based on Global Structure and Local Constraints

Robust Non-Rigid Point Set Registration Using Spatially Constrained Gaussian Fields

Robust 2D Point Set Matching with Kernel Mean P-power Error Loss.

A Robust Non-Rigid Point Set Registration Algorithm Using Both Local and Global Constraints

Robust Point Set Registration Using Signature Quadratic Form Distance

Non-Rigid Point Set Registration with Robust Transformation Estimation under Manifold Regularization