Abstract:LiDAR-based SLAM algorithms are extensively studied to providing robust and accurate positioning for autonomous driving vehicles (ADV) in the past decades. Satisfactory performance can be obtained using high-grade 3D LiDAR with 64 channels, which can provide dense point clouds. Unfortunately, the high price significantly prevents its extensive commercialization in ADV. The cost-effective 3D LiDAR with 16 channels is a promising replacement. However, only limited and sparse point clouds can be provided by the 16 channels LiDAR, which cannot guarantee sufficient positioning accuracy for ADV in challenging dynamic environments. The high-resolution image from the low-cost camera can provide ample information about the surroundings. However, the explicit depth information is not available from the image. Inspired by the complementariness of 3D LiDAR and camera, this paper proposes to make use of the high-resolution images from a camera to enrich the raw 3D point clouds from the low-cost 16 channels LiDAR based on a state-of-the-art deep learning algorithm. An ERFNet is firstly employed to segment the image with the aid of the raw sparse 3D point clouds. Meanwhile, the sparse convolutional neural network is employed to predict the dense point clouds based on raw sparse 3D point clouds. Then, the predicted dense point clouds are fused with the segmentation outputs from ERFnet using a novel multi-layer convolutional neural network to refine the predicted 3D point clouds. Finally, the enriched point clouds are employed to perform LiDAR SLAM based on the state-of-the-art normal distribution transform (NDT). We tested our approach on the re-edited KITTI datasets: (1)the sparse 3D point clouds are significantly enriched with a mean square error of 1.1m MSE. (2)the map generated from the LiDAR SLAM is denser which includes more details without significant accuracy loss.

Range Map Interpolation-Based 3-D LiDAR Truncated Signed Distance Fields Mapping in Outdoor Environments

Range Map Interpolation Based 3D LiDAR Truncated Signed Distance Fields Mapping in Outdoor Environments

Map building for indoor environment with laser range scanner

Building A Dense Surface Map Incrementally from Semi-Dense Point Cloud and Rgb Images

VDBblox: Accurate and Efficient Distance Fields for Path Planning and Mesh Reconstruction

3-D Map Reconstruction in Cross-country Environment

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Intensity Enhanced for Solid-State-lidar in Simultaneous Localization and Mapping

An Effective LiDAR-Inertial SLAM-Based Map Construction Method for Outdoor Environments

Towards Efficient and Robust LiDAR-based 3D Mapping in Urban Environments

3D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation

Mapping 3D visibility in an urban street environment from mobile LiDAR point clouds

3D Reconstruction & Assessment Framework based on affordable 2D Lidar

Use of Depth Completion and SLAM Algorithm to Build Dense Maps of Large Scenes

An Effective Way of Constructing Static Map Using 3D LiDAR for Autonomous Navigation in Outdoor Environments

A Low-Cost 3D Mapping System for Indoor Scenes Based on 2D LiDAR and Monocular Cameras

Reconstruction of High-Precision Semantic Map

N$^{3}$-Mapping: Normal Guided Neural Non-Projective Signed Distance Fields for Large-scale 3D Mapping

LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR

3-D Dense Rangefinder Sensor with a Low-Cost Scanning Mechanism

High-Precision Map Construction in Degraded Long Tunnel Environments of Urban Subways