Abstract:LiDAR-based SLAM algorithms are extensively studied to providing robust and accurate positioning for autonomous driving vehicles (ADV) in the past decades. Satisfactory performance can be obtained using high-grade 3D LiDAR with 64 channels, which can provide dense point clouds. Unfortunately, the high price significantly prevents its extensive commercialization in ADV. The cost-effective 3D LiDAR with 16 channels is a promising replacement. However, only limited and sparse point clouds can be provided by the 16 channels LiDAR, which cannot guarantee sufficient positioning accuracy for ADV in challenging dynamic environments. The high-resolution image from the low-cost camera can provide ample information about the surroundings. However, the explicit depth information is not available from the image. Inspired by the complementariness of 3D LiDAR and camera, this paper proposes to make use of the high-resolution images from a camera to enrich the raw 3D point clouds from the low-cost 16 channels LiDAR based on a state-of-the-art deep learning algorithm. An ERFNet is firstly employed to segment the image with the aid of the raw sparse 3D point clouds. Meanwhile, the sparse convolutional neural network is employed to predict the dense point clouds based on raw sparse 3D point clouds. Then, the predicted dense point clouds are fused with the segmentation outputs from ERFnet using a novel multi-layer convolutional neural network to refine the predicted 3D point clouds. Finally, the enriched point clouds are employed to perform LiDAR SLAM based on the state-of-the-art normal distribution transform (NDT). We tested our approach on the re-edited KITTI datasets: (1)the sparse 3D point clouds are significantly enriched with a mean square error of 1.1m MSE. (2)the map generated from the LiDAR SLAM is denser which includes more details without significant accuracy loss.

DeepPointMap: Advancing LiDAR SLAM with Unified Neural Descriptors

DeepPointMap2: Accurate and Robust LiDAR-Visual SLAM with Neural Descriptors

3D LiDAR Map Compression Using Deep Neural Network.

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields

A Robust Deep Learning Enhanced Monocular SLAM System for Dynamic Environments

A Novel 3D LiDAR SLAM Based on Directed Geometry Point and Sparse Frame

LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR

PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency

A deep-learning real-time visual SLAM system based on multi-task feature extraction network and self-supervised feature points

CP-SLAM: Collaborative Neural Point-based SLAM System

Point-SLAM: Dense Neural Point Cloud-based SLAM

Multi-Objective Location and Mapping Based on Deep Learning and Visual Slam

DF-SLAM: A Deep-Learning Enhanced Visual SLAM System based on Deep Local Features

DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAM

Inertial Aided 3D LiDAR SLAM with Hybrid Geometric Primitives in Large-scale Environments.

D3L-SLAM: A Comprehensive Hybrid Simultaneous Location and Mapping System with Deep Keypoint, Deep Depth, Deep Pose, and Line Detection

DXSLAM: A Robust and Efficient Visual SLAM System with Deep Features.

Utilization of Semantic Planes: Improved Localization and Dense Semantic Map for Monocular SLAM in Urban Environment

Multirobot Collaborative SLAM Based on Novel Descriptor With LiDAR Remote Sensing