Abstract:We present a novel algorithm for semantic segmentation and labeling of 3D point clouds of indoor scenes, where objects in point clouds can have significant variations and complex configurations. Effective segmentation methods decomposing point clouds into semantically meaningful pieces are highly desirable for object recognition, scene understanding, scene modeling, etc. However, existing segmentation methods based on low-level geometry tend to either under-segment or over-segment point clouds. Our method takes a fundamentally different approach, where semantic segmentation is achieved along with labeling. To cope with substantial shape variation for objects in the same category, we first segment point clouds into surface patches and use unsupervised clustering to group patches in the training set into clusters, providing an intermediate representation for effectively learning patch relationships. During testing, we propose a novel patch segmentation and classification framework with multiscale processing, where the local segmentation level is automatically determined by exploiting the learned cluster based contextual information. Our method thus produces robust patch segmentation and semantic labeling results, avoiding parameter sensitivity. We further learn object-cluster relationships from the training set, and produce semantically meaningful object level segmentation. Our method outperforms state-of-the-art methods on several representative point cloud datasets, including S3DIS, SceneNN, Cornell RGB-D and ETH.

Learning Hybrid Semantic Affinity for Point Cloud Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Affinity3D: Propagating Instance-Level Semantic Affinity for Zero-Shot Point Cloud Semantic Segmentation

Multi-modality Affinity Inference for Weakly Supervised 3D Semantic Segmentation

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation

Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation

HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation Via Hybrid Contrastive Regularization

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Weakly-Supervised Semantic Segmentation by Iterative Affinity Learning

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

Associatively Segmenting Instances and Semantics in Point Clouds

Semantic Segmentation of 3D Point Clouds Based on High Precision Range Search Network

Fuzzy Neighborhood Learning for Deep 3-D Segmentation of Point Cloud.

PointAF: A Novel Semantic Segmentation Network for Point Cloud.

Weakly Supervised Point Cloud Segmentation Via Deep Morphological Semantic Information Embedding

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Hybrid3D: learning 3D hybrid features with point clouds and multi-view images for point cloud registration

HDNet: Hybrid Distance Network for semantic segmentation