Abstract:Semantic segmentation of point clouds provided by airborne LiDAR survey in urban scenes is a great challenge. This is due to the fact that point clouds at boundaries of different types of objects are easy to be mixed and have geometric spatial similarity. In addition, the 3D descriptions of the same type of objects have different scales. To address above problems, a fusion attention convolutional network (SMAnet) was proposed in this study. The fusion attention module includes a self-attention module (SAM) and multi-head attention module (MAM). The SAM can capture feature information according to correlation of adjacent point cloud and it can distinguish the mixed point clouds with similar geometric features effectively. The MAM strengthens connections among point clouds according to different subspace features, which is beneficial for distinguishing point clouds at different scales. In feature extraction, lightweight multi-scale feature extraction layers are used to effectively utilize local information of different neighbor fields. Additionally, in order to solve the feature externalization problem and expand the network receptive field, the SoftMax-stochastic pooling (SSP) algorithm is proposed to extract global features. The ISPRS 3D Semantic Labeling Contest dataset was chosen in this study for point cloud segmentation experimentation. Results showed that the overall accuracy and average F1-score of SMAnet reach 85.7% and 75.1%, respectively. It is therefore superior to common algorithms at present. The proposed model also achieved good results on the GML(B) dataset, which proves that the model has good generalization ability.

Large-Scale Semantic 3-D Reconstruction: Outcome of the 2019 IEEE GRSS Data Fusion Contest—Part A

Large-Scale Fine-Grained Building Classification and Height Estimation for Semantic Urban Reconstruction: Outcome of the 2023 IEEE GRSS Data Fusion Contest

SSC: Semantic Scan Context for Large-Scale Place Recognition

The Outcome of the 2021 IEEE GRSS Data Fusion Contest - Track DSE: Detection of Settlements Without Electricity

Semantic 3d Reconstruction Using Multi-View High-Resolution Satellite Images Based On U-Net And Image-Guided Depth Fusion

Open Data for Global Multimodal Land Use Classification: Outcome of the 2017 IEEE GRSS Data Fusion Contest

Fusion of images and point clouds for the semantic segmentation of large-scale 3D scenes based on deep learning

Semantic 3D Reconstruction with Learning MVS and 2D Segmentation of Aerial Images

Large-Scale 3D Shape Reconstruction and Segmentation from ShapeNet Core55.

Deep Sensor Fusion with Pyramid Fusion Networks for 3D Semantic Segmentation

Reconstruction of High-Precision Semantic Map

BuildingFusion: Semantic-Aware Structural Building-Scale 3D Reconstruction.

Real-Time Globally Consistent 3D Reconstruction with Semantic Priors

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

SA-GS: Semantic-Aware Gaussian Splatting for Large Scene Reconstruction with Geometry Constrain

A Prior Level Fusion Approach for the Semantic Segmentation of 3D Point Clouds Using Deep Learning

Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance

Robust Fusion of Multi-Source Images for Accurate 3D Reconstruction of Complex Urban Scenes

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction

3D Semantic Segmentation of Large-Scale Point-Clouds in Urban Areas Using Deep Learning