Abstract:We present a novel method to compute the relative pose of multi-camera systems using two affine correspondences (ACs). Existing solutions to the multi-camera relative pose estimation are either restricted to special cases of motion, have too high computational complexity, or require too many point correspondences (PCs). Thus, these solvers impede an efficient or accurate relative pose estimation when applying RANSAC as a robust estimator. This paper shows that the 6DOF relative pose estimation problem using ACs permits a feasible minimal solution, when exploiting the geometric constraints between ACs and multi-camera systems using a special parameterization. We present a problem formulation based on two ACs that encompass two common types of ACs across two views, i.e., inter-camera and intra-camera. Moreover, the framework for generating the minimal solvers can be extended to solve various relative pose estimation problems, e.g., 5DOF relative pose estimation with known rotation angle prior. Experiments on both virtual and real multi-camera systems prove that the proposed solvers are more efficient than the state-of-the-art algorithms, while resulting in a better relative pose accuracy. Source code is available at <a class="link-external link-https" href="https://github.com/jizhaox/relpose-mcs-depth" rel="external noopener nofollow">this https URL</a>.

Globally Optimal Solution to the Generalized Relative Pose Estimation Problem Using Affine Correspondences

Globally Optimal Relative Pose Estimation Using Affine Correspondences with Known Vertical Direction

Globally Optimal Relative Pose and Scale Estimation from Only Image Correspondences with Known Vertical Direction

Globally Optimal Relative Pose Estimation for Multi-Camera Systems with Known Gravity Direction

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Globally Optimal Relative Pose Estimation with Gravity Prior

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Direct Alignment with Generalized Correspondences: A Unified Framework for Structure-Based Visual Pose Estimation.

Globally Optimal Consensus Maximization for Relative Pose Estimation With Known Gravity Direction

Minimal Cases for Computing the Generalized Relative Pose Using Affine Correspondences

Globally-Optimal Inlier Maximization for Relative Pose Estimation Under Planar Motion

Minimal Solvers for Relative Pose Estimation of Multi-Camera Systems Using Affine Correspondences

An Efficient Solution to the Relative Pose Estimation with a Common Direction.

Minimal Solutions for Relative Pose with a Single Affine Correspondence.

Homography-Based Minimal-Case Relative Pose Estimation with Known Gravity Direction

Robust and Efficient Relative Pose with a Multi-Camera System for Autonomous Driving in Highly Dynamic Environments.

Relative Pose from a Calibrated and an Uncalibrated Smartphone Image

An Efficient Solution To The Homography-Based Relative Pose Problem With A Common Reference Direction

Efficient Recovery of Multi-Camera Motion from Two Affine Correspondences

Affine Correspondences between Multi-Camera Systems for Relative Pose Estimation