Abstract:Making multi-camera visual SLAM systems easier to set up and more robust to the environment is always one of the focuses of vision robots. Existing monocular and binocular vision SLAM systems have narrow FoV and are fragile in textureless environments with degenerated accuracy and limited robustness. Thus multi-camera SLAM systems are gaining attention because they can provide redundancy for texture degeneration with wide FoV. However, current multi-camera SLAM systems face massive data processing pressure and elaborately designed camera configurations, leading to estimation failures for arbitrarily arranged multi-camera systems. To address these problems, we propose a generic visual odometry for arbitrarily arranged multi-cameras, which can achieve metric-scale state estimation with high flexibility in the cameras' arrangement. Specifically, we first design a learning-based feature extraction and tracking framework to shift the pressure of CPU processing of multiple video streams. Then we use the rigid constraints between cameras to estimate the metric scale poses for robust SLAM system initialization. Finally, we fuse the features of the multi-cameras in the SLAM back-end to achieve robust pose estimation and online scale optimization. Additionally, multi-camera features help improve the loop detection for pose graph optimization. Experiments on KITTI-360 and MultiCamData datasets validate the robustness of our method over arbitrarily placed cameras. Compared with other stereo and multi-camera visual SLAM systems, our method obtains higher pose estimation accuracy with better generalization ability. Our codes and online demos are available at \url{<a class="link-external link-https" href="https://github.com/JunhaoWang615/MCVO" rel="external noopener nofollow">this https URL</a>}

Adaptive Ground Plane Estimation for Moving Camera-Based 3D Object Tracking

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Stereo Vision Based SLAM in Outdoor Environments

GCV-SLAM: Ground Constrained Visual SLAM Through Local Ground Planes

Local Optimized and Scalable Frame-to-model SLAM

Vehicle 3d Localization in Road Scenes VIA a Monocular Moving Camera

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization

Monocular Visual Object 3D Localization in Road Scenes

Real-time dense 3D reconstruction and camera tracking via embedded planes representation

Real-Time Trust Region Ground Plane Segmentation For Monocular Mobile Robots

Robust Tracking and Localization using Stable Features of Static Planes in Dynamic Scenes

Conditional simultaneous localization and mapping: A robust visual SLAM system

Monocular Visual-Inertial Navigation for Dynamic Environment

Joint Monocular 3D Vehicle Detection and Tracking

Visual Localization and Mapping Leveraging the Constraints of Local Ground Manifolds

MCVO: A Generic Visual Odometry for Arbitrarily Arranged Multi-Cameras

Angular Tracking Consistency Guided Fast Feature Association for Visual-Inertial SLAM

A Visual SLAM With Tightly-Coupled Integration of Multi-Object Tracking for Production Workshop

Optical coherence tomography findings in multiple evanescent white dot syndrome.

MonoGround: Detecting Monocular 3D Objects from the Ground