Abstract:With the proliferation of Lidar sensors and 3D vision cameras, 3D point cloud analysis has attracted significant attention in recent years. After the success of the pioneer work PointNet, deep learning-based methods have been increasingly applied to various tasks, including 3D point cloud segmentation and 3D object classification. In this paper, we propose a novel 3D point cloud learning network, referred to as Dynamic Point Feature Aggregation Network (DPFA-Net), by selectively performing the neighborhood feature aggregation with dynamic pooling and an attention mechanism. DPFA-Net has two variants for semantic segmentation and classification of 3D point clouds. As the core module of the DPFA-Net, we propose a Feature Aggregation layer, in which features of the dynamic neighborhood of each point are aggregated via a self-attention mechanism. In contrast to other segmentation models, which aggregate features from fixed neighborhoods, our approach can aggregate features from different neighbors in different layers providing a more selective and broader view to the query points, and focusing more on the relevant features in a local neighborhood. In addition, to further improve the performance of the proposed semantic segmentation model, we present two novel approaches, namely Two-Stage BF-Net and BF-Regularization to exploit the background-foreground information. Experimental results show that the proposed DPFA-Net achieves the state-of-the-art overall accuracy score for semantic segmentation on the S3DIS dataset, and provides a consistently satisfactory performance across different tasks of semantic segmentation, part segmentation, and 3D object classification. It is also computationally more efficient compared to other methods.

Point Cloud Recognition Based on Lightweight Embeddable Attention Module

Lightweight Attention Module for Deep Learning on Classification and Segmentation of 3-D Point Clouds

Global Attention-Guided Dual-Domain Point Cloud Feature Learning for Classification and Segmentation

Attention-Based Deep Neural Network for Point Cloud Learning

Point Attention Network for Point Cloud Semantic Segmentation.

Point Attention Network for Semantic Segmentation of 3D Point Clouds

Cyclic Self-attention for Point Cloud Recognition.

Rethinking Local-to-global Representation Learning for Rotation-Invariant Point Cloud Analysis

Graph Attention Neural Networks for Point Cloud Recognition.

Enhanced Local Feature Learning with Simple Offset Attention for Semantic Segmentation of Large-scale Point Clouds

An attention-based bilateral feature fusion network for 3D point cloud

Point Cloud Understanding via Attention-Driven Contrastive Learning

Learning Representative Features by Deep Attention Network for 3D Point Cloud Registration

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

PointAttN: You Only Need Attention for Point Cloud Completion

DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing

SDANet: spatial deep attention-based for point cloud classification and segmentation

Rethinking Attention Module Design for Point Cloud Analysis

Separable Self-Attention Mechanism for Point Cloud Local and Global Feature Modeling

Background-Aware 3D Point Cloud Segmentationwith Dynamic Point Feature Aggregation

CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning