Abstract:Convolutional Neural Networks (CNNs) have performed extremely well on data represented by regularly arranged grids such as images. However, directly leveraging the classic convolution kernels or parameter sharing mechanisms on sparse 3D point clouds is inefficient due to their irregular and unordered nature. We propose a point attention network that learns rich local shape features and their contextual correlations for 3D point cloud semantic segmentation. Since the geometric distribution of the neighboring points is invariant to the point ordering, we propose a Local Attention-Edge Convolution (LAE Conv) to construct a local graph based on the neighborhood points searched in multi-directions. We assign attention coefficients to each edge and then aggregate the point features as a weighted sum of its neighbors. The learned LAE-Conv layer features are then given to a point-wise spatial attention module to generate an interdependency matrix of all points regardless of their distances, which captures long-range spatial contextual features contributing to more precise semantic information. The proposed point attention network consists of an encoder and decoder which, together with the LAE-Conv layers and the point-wise spatial attention modules, make it an end-to-end trainable network for predicting dense labels for 3D point cloud segmentation. Experiments on challenging benchmarks of 3D point clouds show that our algorithm can perform at par or better than the existing state of the art methods.

Pointwise Geometric and Semantic Learning Network on 3D Point Clouds.

Learning Point Cloud Shapes with Geometric and Topological Structures.

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

PointNest: Learning Deep Multiscale Nested Feature Propagation for Semantic Segmentation of 3-D Point Clouds

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

A Point-Based Deep Learning Network for Semantic Segmentation of MLS Point Clouds

Semantic Feature Mining for 3D Object Classification and Segmentation.

Semantic Segmentation of 3D Point Clouds Based on High Precision Range Search Network

Point Attention Network for Semantic Segmentation of 3D Point Clouds

A Multi-scale Network for Semantic Segmentation of 3D Point Clouds

Fuzzy Neighborhood Learning for Deep 3-D Segmentation of Point Cloud.

Three-Dimensional Point Cloud Semantic Segmentation Network Based on Spatial Graph Convolution Network

PointGS: Bridging and Fusing Geometric and Semantic Space for 3D Point Cloud Analysis

Point-Voxel Based Geometry-Adaptive Network for 3D Point Cloud Analysis

A Depth Image Fusion Network for 3D Point Cloud Semantic Segmentation

Knn-Based Feature Learning Network for Semantic Segmentation of Point Cloud Data

A Deep Learning Network for Semantic Labeling of Large-Scale Urban Point Clouds

Local Feature Extraction Network for Point Cloud Analysis

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination

PC-Net: A Deep Network for 3D Point Clouds Analysis.

A Shape-Aware Feature Extraction Module for Semantic Segmentation of 3D Point Clouds.