Abstract:In this paper, we propose a method to segment regions in three-dimensional point clouds. We assume that (i) the shape and the number of regions in the point cloud are not known and (ii) the point cloud may be noisy. The method consists of two steps. In the first step we use a deep neural network to predict the probability that a pair of small patches from the point cloud belongs to the same region. In the second step, we use a convex-optimization based method to improve the predictions of the network by enforcing consistency constraints. We evaluate the accuracy of our method on a custom dataset of convex polyhedra, where the regions correspond to the faces of the polyhedra. The method can be seen as a robust and flexible alternative to the famous region growing segmentation algorithm. All reported results are reproducible and come with easy to use code that could serve as a baseline for future research.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the problem of segmenting regions in 3D point clouds. Specifically, the goals of the paper are: 1. **Deal with regions of unknown shapes and quantities**: In point clouds, the shapes and quantities of regions are not known in advance, which increases the difficulty of segmentation. 2. **Handle noisy data**: Point - cloud data may contain noise, which poses a challenge to accurate segmentation. 3. **Improve the robustness and flexibility of segmentation**: Traditional region - growing algorithms (RGS) are prone to errors when dealing with noisy data and require manual parameter adjustment, which limits their application scope. To achieve these goals, the paper proposes a two - step method: 1. **First step: Prediction using deep neural networks**: Predict the probability that small patches in the point cloud belong to the same region through deep neural networks. This step avoids directly assigning labels, thus solving the label permutation problem. 2. **Second step: Improve prediction using convex optimization**: Improve the prediction results of the network through convex optimization methods to ensure prediction consistency. This step improves the global consistency of segmentation and avoids global errors caused by local errors. The paper evaluated the accuracy of this method through a custom - made data set and compared it with the traditional RGS algorithm. The results show that this method is more robust when dealing with noisy data and does not require manual parameter adjustment. In addition, this method can correctly segment regions with smoothly - transitioning boundaries, while the RGS algorithm is prone to failure in such cases.

Region segmentation via deep learning and convex optimization

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

ProtoSeg: A Prototype-Based Point Cloud Instance Segmentation Method

Dynamic Convolution for 3D Point Cloud Instance Segmentation

Dilated Nearest-Neighbor Encoding for 3D Semantic Segmentation of Point Clouds

Deep Projective 3D Semantic Segmentation

Region Growing Based on 2-D–3-D Mutual Projections for Visible Point Cloud Segmentation

Learning to Segment 3D Point Clouds in 2D Image Space

Deep Learning-Based 3D Instance and Semantic Segmentation: A Review

EDGCNet: Joint Dynamic Hyperbolic Graph Convolution and Dual Squeeze-and-attention for 3D Point Cloud Segmentation

SEGCloud: Semantic Segmentation of 3D Point Clouds

Neighborhood co-occurrence modeling in 3D point cloud segmentation

Indoor Point Cloud segmentation using a modified region growing algorithm and accurate normal estimation

A Point Cloud Segmentation Algorithm Using Local Convexity and Octree

Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

Voxel-based 3D Point Cloud Semantic Segmentation: Unsupervised Geometric and Relationship Featuring vs Deep Learning Methods

Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph

Label-Efficient Learning on Point Clouds using Approximate Convex Decompositions

VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation

Supervoxel-Based Region Growing Segmentation for Point Cloud Data