Abstract:Recently, new semantic segmentation and object detection methods have been proposed for the direct processing of three-dimensional (3D) LiDAR sensor point clouds. LiDAR can produce highly accurate and detailed 3D maps of natural and man-made environments and is used for sensing in many contexts due to its ability to capture more information, its robustness to dynamic changes in the environment compared to an RGB camera, and its cost, which has decreased in recent years and which is an important factor for many application scenarios. The challenge with high-resolution 3D LiDAR sensors is that they can output large amounts of 3D data with up to a few million points per second, which is difficult to process in real time when applying complex algorithms and models for efficient semantic segmentation. Most existing approaches are either only suitable for relatively small point clouds or rely on computationally intensive sampling techniques to reduce their size. As a result, most of these methods do not work in real time in realistic field robotics application scenarios, making them unsuitable for practical applications. Systematic point selection is a possible solution to reduce the amount of data to be processed. Although our approach is memory and computationally efficient, it selects only a small subset of points, which may result in important features being missed. To address this problem, our proposed systematic sampling method called SyS3DS (Systematic Sampling for 3D Semantic Segmentation) incorporates a technique in which the local neighbours of each point are retained to preserve geometric details. SyS3DS is based on the graph colouring algorithm and ensures that the selected points are non-adjacent in order to obtain a subset of points that are representative of the 3D points in the scene. To take advantage of the ensemble learning method, we pass a different subset of nodes for each epoch. This leverages a new technique called auto-ensemble, where ensemble learning is proposed as a collection of different learning models instead of tuning different hyperparameters individually during training and validation. SyS3DS has been shown to process up to 1 million points in a single pass. It outperforms the state of the art in efficient semantic segmentation on large datasets such as Semantic3D. We also present a preliminary study on the validity of the performance of LiDAR-only data, i.e., intensity values from LiDAR sensors without RGB values for semi-autonomous robot perception.

A Preprocessing and Postprocessing Voxel-based Method for LiDAR Semantic Segmentation Improvement in Long Distance

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

Scan-based Semantic Segmentation of LiDAR Point Clouds: An Experimental Study

Rethinking 3D LiDAR Point Cloud Segmentation

MsVFE and V-SIAM: Attention-based multi-scale feature interaction and fusion for outdoor LiDAR semantic segmentation

Ground segmentation based point cloud feature extraction for 3D LiDAR SLAM enhancement

Efficient Multi-Modal High-Precision Semantic Segmentation from MLS Point Cloud Without 3D Annotation

Towards Urban Scene Semantic Segmentation with Deep Learning from LiDAR Point Clouds: A Case Study in Baden-Württemberg, Germany

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

A New Semantic Segmentation Method of Point Cloud Based on PointNet and VoxelNet

A LiDAR point cloud hierarchical semantic segmentation method combining CNN and MRF

Real-Time Semantic Segmentation of LiDAR Point Clouds on Edge Devices for Unmanned Systems

SyS3DS: Systematic Sampling of Large-Scale LiDAR Point Clouds for Semantic Segmentation in Forestry Robotics

Adapting projection-based LiDAR semantic segmentation to natural domains

MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Clouds

Point and Voxel Cross Perception with Lightweight Cosformer for Large-Scale Point Cloud Semantic Segmentation

A Fast Ground Segmentation Method of LiDAR Point Cloud from Coarse-to-Fine

Analysis of LiDAR Configurations on Off-road Semantic Segmentation Performance

Accelerating Point Cloud Ground Segmentation: From Mechanical to Solid-State Lidars

Boosting Lidar 3D Object Detection with Point Cloud Semantic Segmentation

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation