Abstract:Multi-Beam LiDAR (MBL) sensors sample the real-world with discrete 3D point clouds (PC) and have become a major and essential 3D sensing capability for autonomous robots. To ensure an accurate point sampling on surfaces, high-resolution MBL sensors (e.g., Ouster OS0-128) are commonly used to collect dense point clouds for robot tasks, including object detection and tracking, simultaneous localization and mapping (SLAM), in applications such as autonomous driving vehicles (ADVs). However, the high cost and large volume/weight/energy consumption of such sensors limit their usage in broader applications such as UAV/UGV swarms with small-scale agents with limited payload. Existing studies on Super-Resolution (SR) upsampling of the PC from low-resolution MBL have not considered the geometry semantics of the scenes, thus resulting in less optimal SR points for downstream subtasks (e.g., SLAM). Thus, this paper proposes SGSR-Net, a structure semantics-guided MBL Super-Resolution network. SGSR-Net takes the low-resolution range images of the MBL sensors as input and produces dense and structure-aware Super-Resolution point cloud from those sparse measurements through a vertical spatial and channel attention-enhanced CNN model coupling with guided Monte Carlo filtering, for indoor LiDAR-SLAM applications. The SGSR-Net is validated using datasets collected by a UGV equipped with multiple MBL sensors. The results demonstrate that the proposed CG-LSR (CASE Attention Guided Encoder-Decoder LiDAR Super-Resolution Network) reduces the MAE of the SR points by 12.4% down to 0.177 m when compared with the state-of-the-art (SOTA) method [1}, [2], [3], [4]. The indoor SLAM results with SR-points produced by SGSR-Net show that the mean and RMSE of the absolute pose error (APE) are decreased by 27% and 30%, down to 0.849 m and 0.902 m, respectively, which significantly improve the indoor-SLAM performance and stability of SOTA LiDAR-SLAM systems (i.e. LeGO-LOAM [5], [6], [7], [8]).

LSR-RIBNet: A Novel LiDAR Super-Resolution Model for Scene Semantic Segmentation in Outdoor Environments

LiDAR Super-Resolution Based on Segmentation and Geometric Analysis

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

S3Net: 3D LiDAR Sparse Semantic Segmentation Network

SGSR-Net: Structure Semantics Guided LiDAR Super-Resolution Network for Indoor LiDAR SLAM

RAPiD-Seg: Range-Aware Pointwise Distance Distribution Networks for 3D LiDAR Segmentation

RSI-Net: Two-Stream Deep Neural Network for Remote Sensing Images-Based Semantic Segmentation

LISNeRF Mapping: LiDAR-based Implicit Mapping via Semantic Neural Fields for Large-Scale 3D Scenes

A Novel Real-Time Edge-Guided LiDAR Semantic Segmentation Network for Unstructured Environments

Semantic Segmentation Method for Road Intersection Point Clouds Based on Lightweight LiDAR

Dlafnet: A Direct Fusion Method of 2D Aerial Image and 3D Lidar Point Cloud for Semantic Segmentation

On Deep Learning for Geometric and Semantic Scene Understanding Using On-Vehicle 3D LiDAR

LR3S: A lightweight semantic segmentation model for road scenes based on improved DeepLabV3+

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

Improved 3D Semantic Segmentation Model Based on RGB Image and LiDAR Point Cloud Fusion for Automantic Driving

TFNet: Exploiting Temporal Cues for Fast and Accurate LiDAR Semantic Segmentation

Rethinking 3D LiDAR Point Cloud Segmentation

Semantic Segmentation-assisted Scene Completion for LiDAR Point Clouds

LU-Net: A Simple Approach to 3D LiDAR Point Cloud Semantic Segmentation

A Transformer-based Real-time LiDAR Semantic Segmentation Method for Restricted Mobile Devices

Adapting projection-based LiDAR semantic segmentation to natural domains