Abstract:LiDAR point cloud has a complex structure and the 3D semantic labeling of it is a challenging task. Existing methods adopt data transformations without fully exploring contextual features, which are less efficient and accurate problem. In this study, we propose a double self-attention convolutional network, called DAPnet, by combining geometric and contextual features to generate better segmentation results. The double self-attention module including point attention module and group attention module originates from the self-attention mechanism to extract contextual features of terrestrial objects with various shapes and scales. The contextual features extracted by these modules represent the long-range dependencies between the data and are beneficial to reducing the scale diversity of point cloud objects. The point attention module selectively enhances the features by modeling the interdependencies of neighboring points. Meanwhile, the group attention module is used to emphasizes interdependent groups of points. We evaluate our method based on the ISPRS 3D Semantic Labeling Contest dataset and find that our model outperforms the benchmark by 85.2% with an overall accuracy of 90.7%. The improvements over powerline and car are 7.5% and 13%. By conducting ablation comparison, we find that the point attention module is more effective for the overall improvement of the model than the group attention module, and the incorporation of the double self-attention module has an average of 7% improvement on the pre-class accuracy of the classes. Moreover, the adoption of the double self-attention module consumes a similar training time as the one without the attention module for model convergence. The experimental result shows the effectiveness and efficiency of the DAPnet for the segmentation of LiDAR point clouds. The source codes are available at this https URL.

Point Attention Network for Point Cloud Semantic Segmentation.

Point Attention Network for Semantic Segmentation of 3D Point Clouds

Point-based Attention Convolutional Neural Networks for Point Clouds Semantic Segmentation

PointNAC: Copula-Based Point Cloud Semantic Segmentation Network

GA-NET: Global Attention Network for Point Cloud Semantic Segmentation

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Attention-Based Joint Semantic-Instance Segmentation of 3D Point Clouds

PointAttN: You Only Need Attention for Point Cloud Completion

SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation

Cyclic Self-attention for Point Cloud Recognition.

Separable Self-Attention Mechanism for Point Cloud Local and Global Feature Modeling

DAPnet: A Double Self-Attention Convolutional Network for Segmentation of Point Clouds.

PointAF: A Novel Semantic Segmentation Network for Point Cloud.

Bi-Directional Attention for Joint Instance and Semantic Segmentation in Point Clouds

PPNet : Pooling Position Attention Network for Semantic Segmentation

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation

PointMM: Point Cloud Semantic Segmentation CNN under Multi-Spatial Feature Encoding and Multi-Head Attention Pooling

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

DGAT-net: Dynamic Graph Attention for 3D Point Cloud Semantic Segmentation

Subdivision of Adjacent Areas for 3D Point Cloud Semantic Segmentation