Abstract:Recently, generating dense maps in real-time has become a hot research topic in the mobile robotics community, since dense maps can provide more informative and continuous features compared with sparse maps. Implicit depth representation (e.g., the depth code) derived from deep neural networks has been employed in the visual-only or visual-inertial simultaneous localization and mapping (SLAM) systems, which achieve promising performances on both camera motion and local dense geometry estimations from monocular images. However, the existing visual-inertial SLAM systems combined with depth codes are either built on a filter-based SLAM framework, which can only update poses and maps in a relatively small local time window, or based on a loosely-coupled framework, while the prior geometric constraints from the depth estimation network have not been employed for boosting the state estimation. To well address these drawbacks, we propose DiT-SLAM, a novel real-time Dense visual-inertial SLAM with implicit depth representation and Tightly-coupled graph optimization. Most importantly, the poses, sparse maps, and low-dimensional depth codes are optimized with the tightly-coupled graph by considering the visual, inertial, and depth residuals simultaneously. Meanwhile, we propose a light-weight monocular depth estimation and completion network, which is combined with attention mechanisms and the conditional variational auto-encoder (CVAE) to predict the uncertainty-aware dense depth maps from more low-dimensional codes. Furthermore, a robust point sampling strategy introducing the spatial distribution of 2D feature points is also proposed to provide geometric constraints in the tightly-coupled optimization, especially for textureless or featureless cases in indoor environments. We evaluate our system on open benchmarks. The proposed methods achieve better performances on both the dense depth estimation and the trajectory estimation compared to the baseline and other systems.

A Front-End for Dense Monocular SLAM using a Learned Outlier Mask Prior

CNN-SLAM: Real-Time Dense Monocular SLAM with Learned Depth Prediction

Depth Completion with Multiple Balanced Bases and Confidence for Dense Monocular SLAM

Omnidirectional Dense SLAM for Back-to-back Fisheye Cameras

HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields

A Monocular SLAM System with Mask Loop Closing

Ddm-Vslam: Depth Prediction for Dynamic Culling Monocular Vision Slam

Robust Monocular SLAM in Dynamic Environments

Mlc-slam: mask loop closing for monocular slam

Online Mutual Adaptation of Deep Depth Prediction and Visual SLAM

A Robust Deep Learning Enhanced Monocular SLAM System for Dynamic Environments

A Hybrid Sparse-Dense Monocular SLAM System for Autonomous Driving

DeepFactors: Real-Time Probabilistic Dense Monocular SLAM

A dense RGB-D SLAM algorithm based on convolutional neural network of multi-layer image invariant feature

SLAM Endoscopy enhanced by adversarial depth prediction

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

Point-SLAM: Dense Neural Point Cloud-based SLAM

DiT-SLAM: Real-Time Dense Visual-Inertial SLAM with Implicit Depth Representation and Tightly-Coupled Graph Optimization

UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAM

HFNet-SLAM: An Accurate and Real-Time Monocular SLAM System with Deep Features