Abstract:We present a novel algorithm for semantic segmentation and labeling of 3D point clouds of indoor scenes, where objects in point clouds can have significant variations and complex configurations. Effective segmentation methods decomposing point clouds into semantically meaningful pieces are highly desirable for object recognition, scene understanding, scene modeling, etc. However, existing segmentation methods based on low-level geometry tend to either under-segment or over-segment point clouds. Our method takes a fundamentally different approach, where semantic segmentation is achieved along with labeling. To cope with substantial shape variation for objects in the same category, we first segment point clouds into surface patches and use unsupervised clustering to group patches in the training set into clusters, providing an intermediate representation for effectively learning patch relationships. During testing, we propose a novel patch segmentation and classification framework with multiscale processing, where the local segmentation level is automatically determined by exploiting the learned cluster based contextual information. Our method thus produces robust patch segmentation and semantic labeling results, avoiding parameter sensitivity. We further learn object-cluster relationships from the training set, and produce semantically meaningful object level segmentation. Our method outperforms state-of-the-art methods on several representative point cloud datasets, including S3DIS, SceneNN, Cornell RGB-D and ETH.

Point cloud segmentation of 3D scattered parts sampled by RealSense

A New Approach of Point Cloud Processing and Scene Segmentation for Guiding the Visually Impaired

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

Surface Extraction and Boundary Detection Based on DBSCAN Clustering in 3D Point Clouds

3D Surface Segmentation from Point Clouds Via Quadric Fits Based on DBSCAN Clustering

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Planar Point Cloud Segmentation Based on Edge Point Extraction and Redistribution

Scene Segmentation and Understanding for Context-Free Point Clouds

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Scatter Points in Space: 3D Detection from Multi-view Monocular Images

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

Efficient point cloud segmentation approach using energy optimization with geometric features for 3D scene understanding

Attentional Keypoint Detection on Point Clouds for 3D Object Part Segmentation

CPSeg: Cluster-free Panoptic Segmentation of 3D LiDAR Point Clouds

Picking from Clutter: An Object Segmentation Method for Robot Grasping.

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Point cloud segmentation based on Euclidean clustering and multi-plane extraction in rugged field

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Combined Edge- and Stixel-based Object Detection in 3D Point Cloud

Efficient 3D Object Recognition from Cluttered Point Cloud