Abstract:LiDAR-based SLAM algorithms are extensively studied to providing robust and accurate positioning for autonomous driving vehicles (ADV) in the past decades. Satisfactory performance can be obtained using high-grade 3D LiDAR with 64 channels, which can provide dense point clouds. Unfortunately, the high price significantly prevents its extensive commercialization in ADV. The cost-effective 3D LiDAR with 16 channels is a promising replacement. However, only limited and sparse point clouds can be provided by the 16 channels LiDAR, which cannot guarantee sufficient positioning accuracy for ADV in challenging dynamic environments. The high-resolution image from the low-cost camera can provide ample information about the surroundings. However, the explicit depth information is not available from the image. Inspired by the complementariness of 3D LiDAR and camera, this paper proposes to make use of the high-resolution images from a camera to enrich the raw 3D point clouds from the low-cost 16 channels LiDAR based on a state-of-the-art deep learning algorithm. An ERFNet is firstly employed to segment the image with the aid of the raw sparse 3D point clouds. Meanwhile, the sparse convolutional neural network is employed to predict the dense point clouds based on raw sparse 3D point clouds. Then, the predicted dense point clouds are fused with the segmentation outputs from ERFnet using a novel multi-layer convolutional neural network to refine the predicted 3D point clouds. Finally, the enriched point clouds are employed to perform LiDAR SLAM based on the state-of-the-art normal distribution transform (NDT). We tested our approach on the re-edited KITTI datasets: (1)the sparse 3D point clouds are significantly enriched with a mean square error of 1.1m MSE. (2)the map generated from the LiDAR SLAM is denser which includes more details without significant accuracy loss.

Ground segmentation based point cloud feature extraction for 3D LiDAR SLAM enhancement

Classification of LiDAR Point Clouds Using Supervoxel-Based Detrended Feature and Perception-Weighted Graphical Model.

A Staged Real-Time Ground Segmentation Algorithm of 3D LiDAR Point Cloud

FELC-SLAM: Feature Extraction and Loop Closure Optimized Lidar SLAM System

Noise Model Based Line Segmentation for Plane Extraction in Sparse 3D LiDAR Data

3D Lidar SLAM Based on Ground Segmentation and Scan Context Loop Detection

A Novel Framework for Ground Segmentation Using 3D Point Cloud

An Efficient LiDAR SLAM With Angle-Based Feature Extraction and Voxel-Based Fixed-Lag Smoothing

Real-Time Ground-Plane Refined LiDAR SLAM

SFE-SLAM: an effective LiDAR SLAM based on step-by-step feature extraction

A Fast Ground Segmentation Method of LiDAR Point Cloud from Coarse-to-Fine

LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR

SLAM ground point extraction algorithm combining Depth Image and Semantic Segmentation Network

An Improved Fast Ground Segmentation Algorithm for 3D Point Cloud

A Preprocessing and Postprocessing Voxel-based Method for LiDAR Semantic Segmentation Improvement in Long Distance

A LiDAR SLAM System With Geometry Feature Group-Based Stable Feature Selection and Three-Stage Loop Closure Optimization

SuperLine3D: Self-supervised Line Segmentation and Description for LiDAR Point Cloud

A Feature Based Laser SLAM Using Rasterized Images of 3D Point Cloud

A Semantic-Assisted LiDAR SLAM Based on Attention Feature Points

Ground-distance Segmentation of 3D LiDAR Point Cloud Toward Autonomous Driving