Abstract:Fully perceiving the surrounding world is a vital capability for autonomous robots. To achieve this goal, a multi-camera system is usually equipped on the data collecting platform and the structure from motion (SfM) technology is used for scene reconstruction. However, although incremental SfM achieves high-precision modeling, it is inefficient and prone to scene drift in large-scale reconstruction tasks. In this paper, we propose a tailored incremental SfM framework for multi-camera systems, where the internal relative poses between cameras can not only be calibrated automatically but also serve as an additional constraint to improve the system robustness. Previous multi-camera based modeling work has mainly focused on stereo setups or multi-camera systems with known calibration information, but we allow arbitrary configurations and only require images as input. First, one camera is selected as the reference camera, and the other cameras in the multi-camera system are denoted as non-reference cameras. Based on the pose relationship between the reference and non-reference camera, the non-reference camera pose can be derived from the reference camera pose and internal relative poses. Then, a two-stage multi-camera based camera registration module is proposed, where the internal relative poses are computed first by local motion averaging, and then the rigid units are registered incrementally. Finally, a multi-camera based bundle adjustment is put forth to iteratively refine the reference camera and the internal relative poses. Experiments demonstrate that our system achieves higher accuracy and robustness on benchmark data compared to the state-of-the-art SfM and SLAM (simultaneous localization and mapping) methods.

Two-view structure-from-motion algorithm

Obstacle Detection Based on Single View Vision

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

TC-SfM: Robust Track-Community-Based Structure-from-Motion

Efficient Non-Consecutive Feature Tracking for Robust Structure-From-Motion

EC-SfM: Efficient Covisibility-based Structure-from-Motion for Both Sequential and Unordered Images

Detector-Free Structure from Motion

Symmetric Non-Rigid Structure from Motion for Category-Specific Object Structure Estimation

Structure optimization for multi-view acquisition and stereo display system

Visual Geometry Grounded Deep Structure From Motion

Efficient Non-Consecutive Feature Tracking For Structure-From-Motion

Global Structure-from-Motion by Similarity Averaging

MCSfM: Multi-Camera-Based Incremental Structure-From-Motion

Two-View Multibody Structure from Motion

A new geometric approach for three view line reconstruction and motion estimation in Manhattan Scenes

Parallel Structure from Motion from Local Increment to Global Averaging

A Survey On Rotation Optimization In Structure From Motion

CSfM: Community-based Structure from Motion

Extreme Two-View Geometry From Object Poses with Diffusion Models

Structure from Motion for Panorama-Style Videos

DeepMLE: A Robust Deep Maximum Likelihood Estimator for Two-view Structure from Motion