Abstract:Although significant improvement has been achieved in fully autonomous driving and semantic high-definition map (HD) domains, most of the existing 3D point cloud segmentation methods cannot provide high representativeness and remarkable robustness. The principally increasing challenges remain in completely and efficiently extracting high-level 3D point cloud features, specifically in large-scale road environments. This paper provides an end-to-end feature extraction framework for 3D point cloud segmentation by using dynamic point-wise convolutional operations in multiple scales. Compared to existing point cloud segmentation methods that are commonly based on traditional convolutional neural networks (CNNs), our proposed method is less sensitive to data distribution and computational powers. This framework mainly includes four modules. Module I is first designed to construct a revised 3D point-wise convolutional operation. Then, a U-shaped downsampling-upsampling architecture is proposed to leverage both global and local features in multiple scales in Module II. Next, in Module III, high-level local edge features in 3D point neighborhoods are further extracted by using an adaptive graph convolutional neural network based on the K-Nearest Neighbor (KNN) algorithm. Finally, in Module IV, a conditional random field (CRF) algorithm is developed for postprocessing and segmentation result refinement. The proposed method was evaluated on three large-scale LiDAR point cloud datasets in both urban and indoor environments. The experimental results acquired by using different point cloud scenarios indicate our method can achieve state-of-the-art semantic segmentation performance in feature representativeness, segmentation accuracy, and technical robustness.

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation

Ground-distance Segmentation of 3D LiDAR Point Cloud Toward Autonomous Driving

Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR-based Perception

USING SIMULATION DATA FROM GAMING ENVIRONMENTS FOR TRAINING A DEEP LEARNING ALGORITHM ON 3D POINT CLOUDS

Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection

3D Scene Reconstruction with Sparse LiDAR Data and Monocular Image in Single Frame

S3Net: 3D LiDAR Sparse Semantic Segmentation Network

Sparse Points to Dense Clouds: Enhancing 3D Detection with Limited LiDAR Data

Deep Learning for 3D Point Clouds: A Survey

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

MS23D: A 3D object detection method using multi-scale semantic feature points to construct 3D feature layer

Transfer Learning Based Semantic Segmentation for 3D Object Detection from Point Cloud

LDLS: 3-D Object Segmentation Through Label Diffusion From 2-D Images

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph

Optimizing Sparse Convolution on GPUs with CUDA for 3D Point Cloud Processing in Embedded Systems

PV-SSD: A Multi-Modal Point Cloud Feature Fusion Method for Projection Features and Variable Receptive Field Voxel Features