Abstract:Recently, new semantic segmentation and object detection methods have been proposed for the direct processing of three-dimensional (3D) LiDAR sensor point clouds. LiDAR can produce highly accurate and detailed 3D maps of natural and man-made environments and is used for sensing in many contexts due to its ability to capture more information, its robustness to dynamic changes in the environment compared to an RGB camera, and its cost, which has decreased in recent years and which is an important factor for many application scenarios. The challenge with high-resolution 3D LiDAR sensors is that they can output large amounts of 3D data with up to a few million points per second, which is difficult to process in real time when applying complex algorithms and models for efficient semantic segmentation. Most existing approaches are either only suitable for relatively small point clouds or rely on computationally intensive sampling techniques to reduce their size. As a result, most of these methods do not work in real time in realistic field robotics application scenarios, making them unsuitable for practical applications. Systematic point selection is a possible solution to reduce the amount of data to be processed. Although our approach is memory and computationally efficient, it selects only a small subset of points, which may result in important features being missed. To address this problem, our proposed systematic sampling method called SyS3DS (Systematic Sampling for 3D Semantic Segmentation) incorporates a technique in which the local neighbours of each point are retained to preserve geometric details. SyS3DS is based on the graph colouring algorithm and ensures that the selected points are non-adjacent in order to obtain a subset of points that are representative of the 3D points in the scene. To take advantage of the ensemble learning method, we pass a different subset of nodes for each epoch. This leverages a new technique called auto-ensemble, where ensemble learning is proposed as a collection of different learning models instead of tuning different hyperparameters individually during training and validation. SyS3DS has been shown to process up to 1 million points in a single pass. It outperforms the state of the art in efficient semantic segmentation on large datasets such as Semantic3D. We also present a preliminary study on the validity of the performance of LiDAR-only data, i.e., intensity values from LiDAR sensors without RGB values for semi-autonomous robot perception.

PCB-RandNet: Rethinking Random Sampling for LIDAR Semantic Segmentation in Autonomous Driving Scene

Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling.

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

LiDAR Panoptic Segmentation for Autonomous Driving

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

Efficient LiDAR Odometry for Autonomous Driving.

A Fast Ground Segmentation Method of LiDAR Point Cloud from Coarse-to-Fine

LiDAR Point Clouds Semantic Segmentation in Autonomous Driving Based on Asymmetrical Convolution

RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds

SegNet4D: Efficient Instance-Aware 4D Semantic Segmentation for LiDAR Point Cloud

Location-Guided LiDAR-Based Panoptic Segmentation for Autonomous Driving.

Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation

Semantic Segmentation Method for Road Intersection Point Clouds Based on Lightweight LiDAR

SyS3DS: Systematic Sampling of Large-Scale LiDAR Point Clouds for Semantic Segmentation in Forestry Robotics

DGPolarNet: Dynamic Graph Convolution Network for LiDAR Point Cloud Semantic Segmentation on Polar BEV

Hybrid CNN-LSTM Architecture for LiDAR Point Clouds Semantic Segmentation

PANet: LiDAR Panoptic Segmentation with Sparse Instance Proposal and Aggregation

SFPNet: Sparse Focal Point Network for Semantic Segmentation on General LiDAR Point Clouds

Adaptive Polar-Grid Gaussian-Mixture Model for Foreground Segmentation Using Roadside LiDAR

Sparse Single Sweep LiDAR Point Cloud Segmentation Via Learning Contextual Shape Priors from Scene Completion