Abstract:Time of flight (ToF) RGB-D cameras provide a wealth of information for SLAM systems. However, the limited field of view (FOV) of a single ToF RGB-D camera and the small range of its depth measurement module make it prone to degeneracy when relying solely on visual or depth information for SLAM, a problem typical of unimodal SLAM algorithms. To address this issue, this paper presents M-DIVO: an IEKF-based odometry that fuses visual, depth (similar to LiDAR), and inertial modules from multiple ToF RGB-D cameras. It comprises two direct method subsystems: the depth inertial odometry (DIO) subsystem, which constructs point-to-plane constraints from multiple depth modules, and the visual-inertial odometry (VIO) subsystem, which optimizes pose using photometric error constructed by multiple cameras. Additionally, to manage the significant computational load from processing multiple sensors and multimodal information, we introduce a multimodal redundancy scheduling mechanism (MRSM): prioritizing the DIO subsystem with the VIO subsystem as auxiliary, executing the VIO subsystem only when degeneracy occurs in the DIO subsystem. We also propose a “External First, Internal Last" strategy for calibrating multiple external and internal sensors. Experiments demonstrate that compared to unimodal SLAM, our method achieves higher robustness and precision, as well as satisfactory real-time performance. The proposed calibration strategy is demonstrated to be more accurate than the traditional IMU-centric approach. The code is open source.

RGB-D DSO: Direct Sparse Odometry with RGB-D Cameras for Indoor Scenes.

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

RBD-EVIO: Optimized Event-Based Visual-Inertial Odometry for a Large Field of View with a Rotated Binary DART Descriptor.

R2DIO: A Robust and Real-Time Depth-Inertial Odometry Leveraging Multimodal Constraints for Challenging Environments

Enhancing Visual Odometry with Estimated Scene Depth: Leveraging RGB-D Data with Deep Learning

Bi-direction Direct RGB-D Visual Odometry

R 2 DIO: A Robust and Real-Time Depth-Inertial Odometry Leveraging Multi-Modal Constraints for Challenging Environments

Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras

Fast visual odometry and mapping from RGB-D data

Robust Depth-Aided RGBD-Inertial Odometry for Indoor Localization

An indoor DSO-based ceiling-vision odometry system for indoor industrial environments

RGB-D Inertial Odometry for Indoor Robot via Keyframe-based Nonlinear Optimization

R-SDSO: Robust Stereo Direct Sparse Odometry

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

Direct RGB-D visual odometry with point features

DVIO: Depth aided visual inertial odometry for RGBD sensors

DPO: Direct Planar Odometry with Stereo Camera

M-DIVO: Multiple ToF RGB-D Cameras Enhanced Depth-Inertial-Visual Odometry

Feature Assisted Direct Visual Odometry with Virtual Wide Field-of- View Tracking.

DSVO: Direct Stereo Visual Odometry

Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry