Abstract:In this paper, we propose an efficient algorithm, called vector field consensus, for establishing robust point correspondences between two sets of points. Our algorithm starts by creating a set of putative correspondences which can contain a very large number of false correspondences, or outliers, in addition to a limited number of true correspondences (inliers). Next, we solve for correspondence by interpolating a vector field between the two point sets, which involves estimating a consensus of inlier points whose matching follows a nonparametric geometrical constraint. We formulate this a maximum a posteriori (MAP) estimation of a Bayesian model with hidden/latent variables indicating whether matches in the putative set are outliers or inliers. We impose nonparametric geometrical constraints on the correspondence, as a prior distribution, using Tikhonov regularizers in a reproducing kernel Hilbert space. MAP estimation is performed by the EM algorithm which by also estimating the variance of the prior model (initialized to a large value) is able to obtain good estimates very quickly (e.g., avoiding many of the local minima inherent in this formulation). We illustrate this method on data sets in 2D and 3D and demonstrate that it is robust to a very large number of outliers (even up to 90%). We also show that in the special case where there is an underlying parametric geometrical model (e.g., the epipolar line constraint) that we obtain better results than standard alternatives like RANSAC if a large number of outliers are present. This suggests a two-stage strategy, where we use our nonparametric model to reduce the size of the putative set and then apply a parametric variant of our approach to estimate the geometric parameters. Our algorithm is computationally efficient and we provide code for others to use it. In addition, our approach is general and can be applied to other problems, such as learning with a badly corrupted training data set.

Robust Camera Pose Estimation Via Consensus on Ray Bundle and Vector Field.

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

2-Entity Random Sample Consensus for Robust Visual Localization: Framework, Methods, and Verifications

Globally Optimal Consensus Maximization for Robust Visual Inertial Localization in Point and Line Map.

Robust and Efficient Estimation of Absolute Camera Pose for Monocular Visual Odometry.

Robust Orthogonal Iteration Algorithm for Single Camera Pose Estimation

Robust Outlier Removal Using Penalized Linear Regression in Multiview Geometry

Robust Pose Estimation Based on Maximum Correntropy Criterion.

Robust Point Matching via Vector Field Consensus

Robust camera pose estimation from unknown or known line correspondences.

Globally Optimal Consensus Maximization for Relative Pose Estimation With Known Gravity Direction

Determinant-based Pose Estimation Solution to Handle Both Point and Line Outliers

Robust Monocular 3D Car Shape Estimation from 2D Landmarks.

Efficient and Effective Multi-Camera Pose Estimation with Weighted M-Estimate Sample Consensus

A Robust Pose Estimation Method for Nearly Coplanar Points

Robust Robot Pose Estimation for Challenging Scenes With an RGB-D Camera

Robust Stereo Visual Odometry Based on Probabilistic Decoupling Ego-Motion Estimation and 3D SSC

Robust and Efficient Relative Pose with a Multi-Camera System for Autonomous Driving in Highly Dynamic Environments.

Efficient and Outlier-Robust Simultaneous Pose and Correspondence Determination by Branch-and-Bound and Transformation Decomposition

Robust consensus-aware network for 3D point registration

TriVoC: Efficient Voting-Based Consensus Maximization for Robust Point Cloud Registration With Extreme Outlier Ratios