Abstract:With the rapid development of LiDAR and artificial intelligence technologies, 3D point cloud semantic segmentation has become a highlight research topic. This technology is able to significantly enhance the capabilities of building information modeling, navigation and environmental perception. However, current deep learning-based methods primarily rely on voxelization or multi-layer convolution for feature extraction. These methods often face challenges in effectively differentiating between homogeneous objects or structurally adherent targets in complex real-world scenes. To this end, we propose a Graph Transformer point cloud semantic segmentation network (ASGFormer) tailored for structurally adherent objects. Firstly, ASGFormer combines Graph and Transformer to promote global correlation understanding in the graph. Secondly, spatial index and position embedding are constructed based on distance relationships and feature differences. Through a learnable mechanism, the structural weights between points are dynamically adjusted, achieving adaptive spatial structure within the graph. Finally, dummy nodes are introduced to facilitate global information storage and transmission between layers, effectively addressing the issue of information loss at the terminal nodes of the graph. Comprehensive experiments are conducted on the various real-world 3D point cloud datasets, analyzing the effectiveness of proposed ASGFormer through qualitative and quantitative evaluations. ASGFormer outperforms existing approaches with of 91.3% for OA, 78.0% for mAcc, and 72.3% for mIoU on S3DIS dataset. Moreover, ASGFormer achieves 72.8%, 45.5%, 81.6%, 70.1% mIoU on ScanNet, City-Facade, Toronto 3D and Semantic KITTI dataset, respectively. Notably, the proposed method demonstrates effective differentiation of homogeneous structurally adherent objects, further contributing to the intelligent perception and modeling of complex scenes.

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Pass3d: Precise And Accelerated Semantic Segmentation For 3d Point Cloud

Stratified Transformer for 3D Point Cloud Segmentation

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Joint Semantic and Instance Segmentation in 3D Point Cloud Based on Transformer

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Point Cloud Semantic Segmentation with Adaptive Spatial Structure Graph Transformer

Position-Guided Point Cloud Panoptic Segmentation Transformer

Boundary-Aware and Semiautomatic Segmentation of 3-D Object in Point Clouds

Semantic Labeling and Instance Segmentation of 3D Point Clouds Using Patch Context Analysis and Multiscale Processing

Local Transformer Network on 3D Point Cloud Semantic Segmentation

A Transformer-based Real-time LiDAR Semantic Segmentation Method for Restricted Mobile Devices

An Efficient Image-Guided-based 3D Point Cloud Moving Object Segmentation with Transformer-Attention in Autonomous Driving

SGT-Net: A Transformer-Based Stratified Graph Convolutional Network for 3D Point Cloud Semantic Segmentation

Attentional Keypoint Detection on Point Clouds for 3D Object Part Segmentation

PointSeg: A Training-Free Paradigm for 3D Scene Segmentation via Foundation Models

Push-the-Boundary: Boundary-aware Feature Propagation for Semantic Segmentation of 3D Point Clouds

Point and Voxel Cross Perception with Lightweight Cosformer for Large-Scale Point Cloud Semantic Segmentation

A Unified Framework for 3D Scene Understanding

OctFormer: Octree-based Transformers for 3D Point Clouds