Abstract:Decrease in the cost of acquiring 3D point cloud data coupled with the rapid advancements in GPU computing power have resulted in an increased demand for 3D point cloud semantic segmentation in numerous 3D visual applications, including but not limited to autonomous driving, industrial control, and MR/XR, which further advances the development of deep learning methods in 3D point cloud semantic segmentation. Recently, many novel deep learning network architectures, such as RandLA-Net and Point Transformer, have been proposed and have achieved notable improvements in semantic segmentation accuracy while decreasing the computational load. However, previous research on 3D point cloud semantic segmentation methods has focused primarily on relatively early works, whose approaches have been gradually abandoned over the years and cannot accurately reflect the current research status. Moreover, the existing methods have been categorized based on their input data types, making it difficult to compare the segmentation performance of different techniques and not providing a comprehensive view of the relationship between methods using different network architectures. Therefore, this paper reviews the mainstream 3D semantic segmentation methods developed in the last three years using different deep learning network architectures and is organized into three levels. First, the two principal 3D point cloud data acquisition methods, including their customary datasets and metrics to evaluate model performance, are introduced. Second, a systematic review of 3D semantic segmentation methods based on different network architectures is organized, followed by a statistical analysis of the evaluation of performance between different models on two 3D segmentation datasets—S3DIS and ScanNet. The analysis of model performance on these two commonly used datasets includes model structure relevance, strengths, and limitations. Finally, an insightful discussion of the remaining methodological and application challenges and potential research directions is provided. This paper offers an extensive overview of the recent three-year research progress in 3D point cloud semantic segmentation and summarizes various network architecture pipelines, elucidates their fundamental operations, compares the model performance across multiple architectures, discusses their notable strengths and limitations, most importantly, concludes the current challenges and promising research directions for future investigations. Furthermore, this paper enables researchers to effortlessly identify the relevant research and research hotspots among different 3D point cloud semantic segmentation methods based on the analyses presented and aims to update the reviews on 3D point cloud semantic segmentation methods with a better viewpoint and highlight key properties and contributions of proposed methods, providing promising research directions for the main challenges.

Effective Early Stopping of Point Cloud Neural Networks

Rethinking Design and Evaluation of 3D Point Cloud Segmentation Models

3D Point Cloud Semantic Segmentation: State of the Art and Challenges

Early Stopping of Untrained Convolutional Neural Networks

ProtoSeg: A Prototype-Based Point Cloud Instance Segmentation Method

PointHR: Exploring High-Resolution Architectures for 3D Point Cloud Segmentation

Hierarchical Training of Deep Neural Networks Using Early Exiting

A New Semantic Segmentation Method of Point Cloud Based on PointNet and VoxelNet

Real-Time and Accurate Segmentation of 3-D Point Clouds Based on Gaussian Process Regression

Sparse Point-Voxel Aggregation Network for Efficient Point Cloud Semantic Segmentation

Spiking PointNet: Spiking Neural Networks for Point Clouds

PointVoxelFormer -- Reviving point cloud networks for 3D medical imaging

INDOOR 3D POINT CLOUDS SEMANTIC SEGMENTATION BASES ON MODIFIED POINTNET NETWORK

Accurate and Real-Time Object Detection Based on Bird's Eye View on 3D Point Clouds

A Self-Adaptive Segmentation Method for a Point Cloud

A Hierarchical Neural Network for Point Cloud Segmentation and Geometric Primitive Fitting

Equal Emphasis on Data and Network: A Two-Stage 3D Point Cloud Object Detection Algorithm with Feature Alignment

PointeNet: A Lightweight Framework for Effective and Efficient Point Cloud Analysis

Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification

Non-iterative Denoising Algorithm Based on a Dual Threshold for a 3D Point Cloud

Foreground-Background Segmentation of Sequential Point Clouds