Abstract:Recently, generating dense maps in real-time has become a hot research topic in the mobile robotics community, since dense maps can provide more informative and continuous features compared with sparse maps. Implicit depth representation (e.g., the depth code) derived from deep neural networks has been employed in the visual-only or visual-inertial simultaneous localization and mapping (SLAM) systems, which achieve promising performances on both camera motion and local dense geometry estimations from monocular images. However, the existing visual-inertial SLAM systems combined with depth codes are either built on a filter-based SLAM framework, which can only update poses and maps in a relatively small local time window, or based on a loosely-coupled framework, while the prior geometric constraints from the depth estimation network have not been employed for boosting the state estimation. To well address these drawbacks, we propose DiT-SLAM, a novel real-time Dense visual-inertial SLAM with implicit depth representation and Tightly-coupled graph optimization. Most importantly, the poses, sparse maps, and low-dimensional depth codes are optimized with the tightly-coupled graph by considering the visual, inertial, and depth residuals simultaneously. Meanwhile, we propose a light-weight monocular depth estimation and completion network, which is combined with attention mechanisms and the conditional variational auto-encoder (CVAE) to predict the uncertainty-aware dense depth maps from more low-dimensional codes. Furthermore, a robust point sampling strategy introducing the spatial distribution of 2D feature points is also proposed to provide geometric constraints in the tightly-coupled optimization, especially for textureless or featureless cases in indoor environments. We evaluate our system on open benchmarks. The proposed methods achieve better performances on both the dense depth estimation and the trajectory estimation compared to the baseline and other systems.

CodeVIO: Visual-Inertial Odometry with Learned Optimizable Dense Depth

Self-supervised Visual-LiDAR Odometry with Flip Consistency

LODM: Large-scale Online Dense Mapping for UAV

RLP‐VIO: Robust and Lightweight Plane‐based Visual‐inertial Odometry for Augmented Reality

RNIN-VIO: Robust Neural Inertial Navigation Aided Visual-Inertial Odometry in Challenging Scenes

Unsupervised Monocular Visual-Inertial Odometry Network

Robust Neural Visual Inertial Odometry with Deep Velocity Constraint

DVIO: Depth aided visual inertial odometry for RGBD sensors

Robust and Efficient Visual-Inertial Odometry with Multi-plane Priors.

DiT-SLAM: Real-Time Dense Visual-Inertial SLAM with Implicit Depth Representation and Tightly-Coupled Graph Optimization

Robust Tightly-Coupled Visual-Inertial Odometry with Pre-built Maps in High Latency Situations

Adaptive VIO: Deep Visual-Inertial Odometry with Online Continual Learning

Deep Depth Estimation from Visual-Inertial SLAM

SimpleMapping: Real-Time Visual-Inertial Dense Mapping with Deep Multi-View Stereo

CoVIO: Online Continual Learning for Visual-Inertial Odometry

SelfVIO: Self-Supervised Deep Monocular Visual-Inertial Odometry and Depth Estimation

CodedVO: Coded Visual Odometry

Improving Monocular Visual Odometry Using Learned Depth

Lightweight hybrid visual-inertial odometry with closed-form zero velocity update

CodeMapping: Real-Time Dense Mapping for Sparse SLAM using Compact Scene Representations

Multi-Sensor Fusion Self-Supervised Deep Odometry and Depth Estimation