Abstract:Estimating pose from given 3D correspondences, including point-to-point, point-to-line and point-to-plane correspondences, is a fundamental task in computer vision with many applications. We present a complete solution for this task, including a solution for the minimal problem and the least-squares problem of this task. Previous works mainly focused on finding the global minimizer to address the least-squares problem. However, existing works that show the ability to achieve global minimizer are still unsuitable for real-time applications. Furthermore, as one of contributions of this paper, we prove that there exist ambiguous configurations for any number of lines and planes. These configurations have several solutions in theory, which makes the correct solution may come from a local minimizer. Our algorithm is efficient and able to reveal local minimizers. We employ the Cayley-Gibbs-Rodriguez (CGR) parameterization of the rotation to derive a general rational cost for the three cases of 3D correspondences. The main contribution of this paper is to solve the resulting equation system of the minimal problem and the first-order optimality conditions of the least-squares problem, both of which are of complicated rational forms. The central idea of our algorithm is to introduce intermediate unknowns to simplify the problem. Extensive experimental results show that our algorithm significantly outperforms previous algorithms when the number of correspondences is small. Besides, when the global minimizer is the solution, our algorithm achieves the same accuracy as previous algorithms that have guaranteed global optimality, but our algorithm is applicable to real-time applications.

Minimal Solutions for Relative Pose with a Single Affine Correspondence.

Developing Rigid Constraint for the Estimation of Pose and Structure from a Single Image

On Relative Pose Recovery for Multi-Camera Systems

Affine Correspondences between Multi-Camera Systems for Relative Pose Estimation

Planar Motion Estimation for Multi-camera System.

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Relative Pose Estimation for Multi-Camera Systems from Point Correspondences with Scale Ratio

Linear Relative Pose Estimation Founded on Pose-only Imaging Geometry

An Efficient Method to Recover Relative Pose for Vehicle-Mounted Cameras under Planar Motion.

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Relative pose of three calibrated and partially calibrated cameras from four points using virtual correspondences

Do not Omit Local Minimizer: a Complete Solution for Pose Estimation from 3D Correspondences

Trifocal Relative Pose from Lines at Points and its Efficient Solution

Efficient and Outlier-Robust Simultaneous Pose and Correspondence Determination by Branch-and-Bound and Transformation Decomposition

Globally-Optimal Inlier Maximization for Relative Pose Estimation Under Planar Motion

Six-Point Method for Multi-Camera Systems with Reduced Solution Space

Are Minimal Radial Distortion Solvers Necessary for Relative Pose Estimation?

An Accurate and Real-time Relative Pose Estimation from Triple Point-line Images by Decoupling Rotation and Translation

Stereo relative pose from line and point feature triplets

Globally Optimal Relative Pose Estimation for Multi-Camera Systems with Known Gravity Direction