Abstract:Recently, generating dense maps in real-time has become a hot research topic in the mobile robotics community, since dense maps can provide more informative and continuous features compared with sparse maps. Implicit depth representation (e.g., the depth code) derived from deep neural networks has been employed in the visual-only or visual-inertial simultaneous localization and mapping (SLAM) systems, which achieve promising performances on both camera motion and local dense geometry estimations from monocular images. However, the existing visual-inertial SLAM systems combined with depth codes are either built on a filter-based SLAM framework, which can only update poses and maps in a relatively small local time window, or based on a loosely-coupled framework, while the prior geometric constraints from the depth estimation network have not been employed for boosting the state estimation. To well address these drawbacks, we propose DiT-SLAM, a novel real-time Dense visual-inertial SLAM with implicit depth representation and Tightly-coupled graph optimization. Most importantly, the poses, sparse maps, and low-dimensional depth codes are optimized with the tightly-coupled graph by considering the visual, inertial, and depth residuals simultaneously. Meanwhile, we propose a light-weight monocular depth estimation and completion network, which is combined with attention mechanisms and the conditional variational auto-encoder (CVAE) to predict the uncertainty-aware dense depth maps from more low-dimensional codes. Furthermore, a robust point sampling strategy introducing the spatial distribution of 2D feature points is also proposed to provide geometric constraints in the tightly-coupled optimization, especially for textureless or featureless cases in indoor environments. We evaluate our system on open benchmarks. The proposed methods achieve better performances on both the dense depth estimation and the trajectory estimation compared to the baseline and other systems.

Direct Near-Infrared-Depth Visual SLAM With Active Lighting

Research on Visual SLAM System Based on Near-Infrared Perception

A robust stereo feature-aided semi-direct SLAM system

SLAM in Low-Light Environments Based on Infrared-Visible Light Fusion

Sparse Depth Enhanced Direct Thermal-Infrared SLAM Beyond the Visible Spectrum

EIL‐SLAM: Depth‐enhanced edge‐based infrared‐LiDAR SLAM

Thermal-Inertial SLAM for the Environments With Challenging Illumination

Light-SLAM: A Robust Deep-Learning Visual SLAM System Based on LightGlue under Challenging Lighting Conditions

VI-NeRF-SLAM: a real-time visual–inertial SLAM with NeRF mapping

Deep Depth Estimation from Visual-Inertial SLAM

LI-SLAM: Fusing LiDAR and Infrared Camera for Simultaneous Localization and Mapping

An Adaptive Lighting Indoor vSLAM With Limited On-Device Resources

RGB-D-Inertial SLAM in Indoor Dynamic Environments with Long-term Large Occlusion

Direct Depth SLAM: Sparse Geometric Feature Enhanced Direct Depth SLAM System for Low-Texture Environments

DiT-SLAM: Real-Time Dense Visual-Inertial SLAM with Implicit Depth Representation and Tightly-Coupled Graph Optimization

NID-SLAM: Neural Implicit Representation-based RGB-D SLAM in dynamic environments

SLAIM: Robust Dense Neural SLAM for Online Tracking and Mapping

AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System

Semi-direct Monocular Visual and Visual-Inertial SLAM with Loop Closure Detection

NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoising

DLD-SLAM: RGB-D Visual Simultaneous Localisation and Mapping in Indoor Dynamic Environments Based on Deep Learning