Abstract:Recently, graph-based and Transformer-based deep learning networks have demonstrated excellent performances on various point cloud tasks. Most of the existing graph methods are based on static graph, which take a fixed input to establish graph relations. Moreover, many graph methods apply maximization and averaging to aggregate neighboring features, so that only a single neighboring point affects the feature of centroid or different neighboring points have the same influence on the centroid's feature, which ignoring the correlation and difference between points. Most Transformer-based methods extract point cloud features based on global attention and lack the feature learning on local neighbors. To solve the problems of these two types of models, we propose a new feature extraction block named Graph Transformer and construct a 3D point point cloud learning network called GTNet to learn features of point clouds on local and global patterns. Graph Transformer integrates the advantages of graph-based and Transformer-based methods, and consists of Local Transformer and Global Transformer modules. Local Transformer uses a dynamic graph to calculate all neighboring point weights by intra-domain cross-attention with dynamically updated graph relations, so that every neighboring point could affect the features of centroid with different weights; Global Transformer enlarges the receptive field of Local Transformer by a global self-attention. In addition, to avoid the disappearance of the gradient caused by the increasing depth of network, we conduct residual connection for centroid features in GTNet; we also adopt the features of centroid and neighbors to generate the local geometric descriptors in Local Transformer to strengthen the local information learning capability of the model. Finally, we use GTNet for shape classification, part segmentation and semantic segmentation tasks in this paper.

MGT-PC: Memory-Guided Transformer for Robust Point Cloud Classification

Improving Adversarial Robustness of 3D Point Cloud Classification Models

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

EGCT: Enhanced Graph Convolutional Transformer for 3D Point Cloud Representation Learning

Robust 3D Point Cloud Recognition: Enhancing Robustness with GPT-4 and CLIP Integration

PointGPT: Auto-regressively Generative Pre-training from Point Clouds

Target-Guided Adversarial Point Cloud Transformer Towards Recognition Against Real-world Corruptions

Point Cloud Classification Based on Transformer

Multi-scale Geometry-aware Transformer for 3D Point Cloud Classification

CAP: Robust Point Cloud Classification Via Semantic and Structural Modeling.

DGC-TnT: Enhancing Point Cloud Object Classification by Dynamic Graph Convolutions With Transformer in Transformer

Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradients

AdvPC: Transferable Adversarial Perturbations on 3D Point Clouds

PCT: Point cloud transformer

PointGT: A Method for Point-Cloud Classification and Segmentation Based on Local Geometric Transformation

TCPNet: A 3D Point Cloud Classification Model Based on the Advanced CNN and Transformer

GTNet: Graph Transformer Network for 3D Point Cloud Classification and Semantic Segmentation

PU-CTG: A Point Cloud Upsampling Network Using Transformer Fusion and GRU Correction

PointGuard: Provably Robust 3D Point Cloud Classification

PTC-Net: Point-Wise Transformer with Sparse Convolution Network for Place Recognition.

PointMT: Efficient Point Cloud Analysis with Hybrid MLP-Transformer Architecture