Abstract:The point cloud semantic segmentation network based on point-wise multi-layer perceptron (MLP) has gained extensive applications because of its end-to-end advantages. However, there exist two major limitations for this type of network: (1) In a neighborhood ball, the relative features between the central point and its neighboring point are not adequately exploited. (2) Only the relative features in the neighborhood ball are extracted, but the overall morphological information of the neighborhood ball is ignored. To overcome the limitations, this paper proposes two-fold improvements on local structure information extraction: (1) The relative angular feature is added and combined with other initial features as the input of the model to exploit the relative geometric features between points to the greatest extent. (2) The unordered points in the neighborhood ball are reordered based on the space-filling curve (SFC) and then fed into the MLP to extract the overall structure information of the neighborhood ball. And a semantic segmentation model is developed based on the two proposed feature extraction modules and U-Net, which is evaluated on two public datasets. The experimental result has demonstrated that the two proposed feature extraction modules can effectively extract geometric information in the point cloud and the proposed semantic segmentation model has strong semantic recognition capability for objects with complex morphologies. The mean intersection over union (mIoU) of the proposed model reached 70.6% and 47.8% for the Semantic 3D and Semantic KITTI datasets, respectively. Besides, the proposed model achieves real-time segmentation with only four encoder layers.

Point Cloud Semantic Segmentation Algorithm Based on Multi-information Markov Random Field

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

A Point Cloud Segmentation Algorithm Based on Multi-Feature Training and Weighted Random Forest

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

MSIDA-Net: Point Cloud Semantic Segmentation via Multi-Spatial Information and Dual Adaptive Blocks

A LiDAR point cloud hierarchical semantic segmentation method combining CNN and MRF

Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion

A Unified 3 D Mesh Segmentation Framework Based on Markov Random Field

Efficient Multi-Modal High-Precision Semantic Segmentation from MLS Point Cloud Without 3D Annotation

Splitting and Merging Based Multi-model Fitting for Point Cloud Segmentation

Region Growing Based on 2-D–3-D Mutual Projections for Visible Point Cloud Segmentation

PointAF: A Novel Semantic Segmentation Network for Point Cloud.

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Extraction of local structure information of point clouds through space-filling curve for semantic segmentation

A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation

PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling

MLFNet- Point Cloud Semantic Segmentation Convolution Network Based on Multi-Scale Feature Fusion