Abstract:LiDAR-based SLAM algorithms are extensively studied to providing robust and accurate positioning for autonomous driving vehicles (ADV) in the past decades. Satisfactory performance can be obtained using high-grade 3D LiDAR with 64 channels, which can provide dense point clouds. Unfortunately, the high price significantly prevents its extensive commercialization in ADV. The cost-effective 3D LiDAR with 16 channels is a promising replacement. However, only limited and sparse point clouds can be provided by the 16 channels LiDAR, which cannot guarantee sufficient positioning accuracy for ADV in challenging dynamic environments. The high-resolution image from the low-cost camera can provide ample information about the surroundings. However, the explicit depth information is not available from the image. Inspired by the complementariness of 3D LiDAR and camera, this paper proposes to make use of the high-resolution images from a camera to enrich the raw 3D point clouds from the low-cost 16 channels LiDAR based on a state-of-the-art deep learning algorithm. An ERFNet is firstly employed to segment the image with the aid of the raw sparse 3D point clouds. Meanwhile, the sparse convolutional neural network is employed to predict the dense point clouds based on raw sparse 3D point clouds. Then, the predicted dense point clouds are fused with the segmentation outputs from ERFnet using a novel multi-layer convolutional neural network to refine the predicted 3D point clouds. Finally, the enriched point clouds are employed to perform LiDAR SLAM based on the state-of-the-art normal distribution transform (NDT). We tested our approach on the re-edited KITTI datasets: (1)the sparse 3D point clouds are significantly enriched with a mean square error of 1.1m MSE. (2)the map generated from the LiDAR SLAM is denser which includes more details without significant accuracy loss.

HALS: A Height-Aware Lidar Super-Resolution Framework for Autonomous Driving

Adaptive point cloud acquisition and upsampling for automotive lidar

Efficient LiDAR Odometry for Autonomous Driving.

Up-Sampling Method for Low-Resolution LiDAR Point Cloud to Enhance 3D Object Detection in an Autonomous Driving Environment

Lidar Upsampling with Sliced Wasserstein Distance

LiDAR Panoptic Segmentation for Autonomous Driving

DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications

A Multi-Lidar-based Point Cloud Acquisition Platform and Data Fusion for Autonomous Vehicle in Complex Urban Environment

TULIP: Transformer for Upsampling of LiDAR Point Clouds

3D Reconstruction & Assessment Framework based on affordable 2D Lidar

A decentralized framework for simultaneous calibration, localization and mapping with multiple LiDARs

Software-Defined Active LiDARs for Autonomous Driving: A Parallel Intelligence-Based Adaptive Model

Hierarchical Fusion based High Precision SLAM for Solid-State Lidar

LiDAR Data Enrichment Using Deep Learning Based on High-Resolution Image: An Approach to Achieve High-Performance LiDAR SLAM Using Low-cost LiDAR

Enhancing the Reliability of LiDAR Point Cloud Sampling: A Colorization and Super-Resolution Approach Based on LiDAR-Generated Images

SLIM: Scalable and Lightweight LiDAR Mapping in Urban Environments

HVL-SLAM: Hybrid Vision and LiDAR Fusion for SLAM

FinderNet: A Data Augmentation Free Canonicalization aided Loop Detection and Closure technique for Point clouds in 6-DOF separation

ZUST Campus: A Lightweight and Practical LiDAR SLAM Dataset for Autonomous Driving Scenarios

AN EVALUATION OF SOLID-STATE LIDAR FOR LOCALIZATION AND HD POINT CLOUD MAPPING