Abstract:Recently, generating dense maps in real-time has become a hot research topic in the mobile robotics community, since dense maps can provide more informative and continuous features compared with sparse maps. Implicit depth representation (e.g., the depth code) derived from deep neural networks has been employed in the visual-only or visual-inertial simultaneous localization and mapping (SLAM) systems, which achieve promising performances on both camera motion and local dense geometry estimations from monocular images. However, the existing visual-inertial SLAM systems combined with depth codes are either built on a filter-based SLAM framework, which can only update poses and maps in a relatively small local time window, or based on a loosely-coupled framework, while the prior geometric constraints from the depth estimation network have not been employed for boosting the state estimation. To well address these drawbacks, we propose DiT-SLAM, a novel real-time Dense visual-inertial SLAM with implicit depth representation and Tightly-coupled graph optimization. Most importantly, the poses, sparse maps, and low-dimensional depth codes are optimized with the tightly-coupled graph by considering the visual, inertial, and depth residuals simultaneously. Meanwhile, we propose a light-weight monocular depth estimation and completion network, which is combined with attention mechanisms and the conditional variational auto-encoder (CVAE) to predict the uncertainty-aware dense depth maps from more low-dimensional codes. Furthermore, a robust point sampling strategy introducing the spatial distribution of 2D feature points is also proposed to provide geometric constraints in the tightly-coupled optimization, especially for textureless or featureless cases in indoor environments. We evaluate our system on open benchmarks. The proposed methods achieve better performances on both the dense depth estimation and the trajectory estimation compared to the baseline and other systems.

Dense Visual SLAM with Probabilistic Surfel Map

Local Optimized and Scalable Frame-to-model SLAM

Dense RGB-D-Inertial SLAM with Map Deformations

DP-SLAM: A visual SLAM with moving probability towards dynamic environments

A Dense Visual SLAM Method in Dynamic Scenes

Surfel-Based Dense Rgb-D Reconstruction With Global And Local Consistency

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization

Real-Time Optimization-Based Dense Mapping System of RGBD-Inertial Odometry

P2U-SLAM: A Monocular Wide-FoV SLAM System Based on Point Uncertainty and Pose Uncertainty

PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environments

A Robust Visual SLAM System in Dynamic Environment

RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior

Semi-Direct Multimap SLAM System for Real-Time Sparse 3-D Map Reconstruction

FD-SLAM: 3-D Reconstruction Using Features and Dense Matching

DiT-SLAM: Real-Time Dense Visual-Inertial SLAM with Implicit Depth Representation and Tightly-Coupled Graph Optimization

Real-Time Dense Visual Odometry for RGB-D Cameras

DGS-SLAM: A Fast and Robust RGBD SLAM in Dynamic Environments Combined by Geometric and Semantic Information

A Semi-Dense Feature-based VSLAM System

DPC-SLAM: Discrete Plane Constrained VSLAM for Intelligent Vehicle in Road Environment

POU-SLAM: Scan-to-Model Matching Based on 3D Voxels