Abstract:With the proliferation of Lidar sensors and 3D vision cameras, 3D point cloud analysis has attracted significant attention in recent years. After the success of the pioneer work PointNet, deep learning-based methods have been increasingly applied to various tasks, including 3D point cloud segmentation and 3D object classification. In this paper, we propose a novel 3D point cloud learning network, referred to as Dynamic Point Feature Aggregation Network (DPFA-Net), by selectively performing the neighborhood feature aggregation with dynamic pooling and an attention mechanism. DPFA-Net has two variants for semantic segmentation and classification of 3D point clouds. As the core module of the DPFA-Net, we propose a Feature Aggregation layer, in which features of the dynamic neighborhood of each point are aggregated via a self-attention mechanism. In contrast to other segmentation models, which aggregate features from fixed neighborhoods, our approach can aggregate features from different neighbors in different layers providing a more selective and broader view to the query points, and focusing more on the relevant features in a local neighborhood. In addition, to further improve the performance of the proposed semantic segmentation model, we present two novel approaches, namely Two-Stage BF-Net and BF-Regularization to exploit the background-foreground information. Experimental results show that the proposed DPFA-Net achieves the state-of-the-art overall accuracy score for semantic segmentation on the S3DIS dataset, and provides a consistently satisfactory performance across different tasks of semantic segmentation, part segmentation, and 3D object classification. It is also computationally more efficient compared to other methods.

3D Point Cloud Classification and Segmentation Based on Dual Attention and Weighted Dynamic Graph Convolution

3D Point Cloud Classification Method Based on Multiple Attention Mechanism and Dynamic Graph Convolution

A 3D Point Cloud Classification Method Based on Adaptive Graph Convolution and Global Attention

Point Cloud Classification by Dynamic Graph CNN with Adaptive Feature Fusion.

Dual-Graph Attention Convolution Network for 3-D Point Cloud Classification

A feature fusion-based attention graph convolutional network for 3D classification and segmentation

3D Point Cloud Classification Segmentation Model Based on Improved PointNet++

3D Point Clouds Classification and Segmentation Network Based on Global Features

Multi-view attention-convolution pooling network for 3D point cloud classification

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

EDGCNet: Joint Dynamic Hyperbolic Graph Convolution and Dual Squeeze-and-attention for 3D Point Cloud Segmentation

Point Attention Network for Semantic Segmentation of 3D Point Clouds

Multi-Head Self-Attention for 3D Point Cloud Classification

Point Cloud Segmentation via Edge-fused Local Graph Learning

Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

AGNet: An Attention-Based Graph Network for Point Cloud Classification and Segmentation

Background-Aware 3D Point Cloud Segmentationwith Dynamic Point Feature Aggregation

Three-Dimensional Point Cloud Semantic Segmentation Network Based on Spatial Graph Convolution Network

Graph Convolutional Network using Self-Attention Module in Point Cloud Classification

Global Attention-Guided Dual-Domain Point Cloud Feature Learning for Classification and Segmentation

Geometric attentional dynamic graph convolutional neural networks for point cloud analysis