Abstract:With the rapid development of LiDAR and artificial intelligence technologies, 3D point cloud semantic segmentation has become a highlight research topic. This technology is able to significantly enhance the capabilities of building information modeling, navigation and environmental perception. However, current deep learning-based methods primarily rely on voxelization or multi-layer convolution for feature extraction. These methods often face challenges in effectively differentiating between homogeneous objects or structurally adherent targets in complex real-world scenes. To this end, we propose a Graph Transformer point cloud semantic segmentation network (ASGFormer) tailored for structurally adherent objects. Firstly, ASGFormer combines Graph and Transformer to promote global correlation understanding in the graph. Secondly, spatial index and position embedding are constructed based on distance relationships and feature differences. Through a learnable mechanism, the structural weights between points are dynamically adjusted, achieving adaptive spatial structure within the graph. Finally, dummy nodes are introduced to facilitate global information storage and transmission between layers, effectively addressing the issue of information loss at the terminal nodes of the graph. Comprehensive experiments are conducted on the various real-world 3D point cloud datasets, analyzing the effectiveness of proposed ASGFormer through qualitative and quantitative evaluations. ASGFormer outperforms existing approaches with of 91.3% for OA, 78.0% for mAcc, and 72.3% for mIoU on S3DIS dataset. Moreover, ASGFormer achieves 72.8%, 45.5%, 81.6%, 70.1% mIoU on ScanNet, City-Facade, Toronto 3D and Semantic KITTI dataset, respectively. Notably, the proposed method demonstrates effective differentiation of homogeneous structurally adherent objects, further contributing to the intelligent perception and modeling of complex scenes.

FAT: Field-Aware Transformer for Point Cloud Segmentation with Adaptive Attention Fields

Fat: Field-Aware Transformer for 3D Point Cloud Semantic Segmentation

SAT: Size-Aware Transformer for 3D Point Cloud Semantic Segmentation

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

A FREE LUNCH FROM VIT: ADAPTIVE ATTENTION MULTI-SCALE FUSION TRANSFORMER FOR FINE-GRAINED VISUAL RECOGNITION

CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning

A free lunch from ViT:Adaptive Attention Multi-scale Fusion Transformer for Fine-grained Visual Recognition

Lightweight Vision Transformer with Bidirectional Interaction

Local Transformer Network on 3D Point Cloud Semantic Segmentation

MPCT: Multiscale Point Cloud Transformer with a Residual Network

Soft Masked Transformer for Point Cloud Processing with Skip Attention-Based Upsampling

OctFormer: Octree-based Transformers for 3D Point Clouds

AAFormer: Attention-Attended Transformer for Semantic Segmentation of Remote Sensing Images

Position-Guided Point Cloud Panoptic Segmentation Transformer

TopoSeg: Topology-aware Segmentation for Point Clouds.

FatNet: A Feature-attentive Network for 3D Point Cloud Processing

3DPCT: 3D Point Cloud Transformer with Dual Self-attention

CFATransUnet: Channel-wise cross fusion attention and transformer for 2D medical image segmentation

PointCAT: Cross-Attention Transformer for point cloud

Stratified Transformer for 3D Point Cloud Segmentation

Point Cloud Semantic Segmentation with Adaptive Spatial Structure Graph Transformer