Abstract:Although significant improvement has been achieved in fully autonomous driving and semantic high-definition map (HD) domains, most of the existing 3D point cloud segmentation methods cannot provide high representativeness and remarkable robustness. The principally increasing challenges remain in completely and efficiently extracting high-level 3D point cloud features, specifically in large-scale road environments. This paper provides an end-to-end feature extraction framework for 3D point cloud segmentation by using dynamic point-wise convolutional operations in multiple scales. Compared to existing point cloud segmentation methods that are commonly based on traditional convolutional neural networks (CNNs), our proposed method is less sensitive to data distribution and computational powers. This framework mainly includes four modules. Module I is first designed to construct a revised 3D point-wise convolutional operation. Then, a U-shaped downsampling-upsampling architecture is proposed to leverage both global and local features in multiple scales in Module II. Next, in Module III, high-level local edge features in 3D point neighborhoods are further extracted by using an adaptive graph convolutional neural network based on the K-Nearest Neighbor (KNN) algorithm. Finally, in Module IV, a conditional random field (CRF) algorithm is developed for postprocessing and segmentation result refinement. The proposed method was evaluated on three large-scale LiDAR point cloud datasets in both urban and indoor environments. The experimental results acquired by using different point cloud scenarios indicate our method can achieve state-of-the-art semantic segmentation performance in feature representativeness, segmentation accuracy, and technical robustness.

Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

Deep Neural Network for Point Sets Based on Local Feature Integration

Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

MInet: A Novel Network Model for Point Cloud Processing by Integrating Multi-Modal Information

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network

Multi-Scale PointPillars 3D Object Detection Network

Multi-Head Self-Attention for 3D Point Cloud Classification

DGCB-Net: Dynamic Graph Convolutional Broad Network for 3D Object Recognition in Point Cloud

Using Multi-Scale and Hierarchical Deep Convolutional Features for 3D Semantic Classification of TLS Point Clouds.

Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds

PVNet: A Joint Convolutional Network of Point Cloud and Multi-View for 3D Shape Recognition.

Multi-level 3D CNN for Learning Multi-scale Spatial Features

DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

PointNest: Learning Deep Multiscale Nested Feature Propagation for Semantic Segmentation of 3-D Point Clouds

Optimized CNNs for Rapid 3D Point Cloud Object Recognition

Multi-Scale Superpoint Network for 3D Point Cloud Semantic Segmentation.

Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation

Multi-Scale Neighborhood Feature Extraction and Aggregation for Point Cloud Segmentation