Abstract:<p>Semantic interpretation of the 3D scene is one of the most challenging problems in point cloud processing, which also deems as an essential task in a wide variety of point cloud applications. The core task of semantic interpretation is semantic labeling, namely, obtaining a unique semantic label for each point in the point cloud. Despite several reported approaches, semantic labeling continues to be a challenge owing to the complexity of scenes, objects of various scales, and the non-homogeneity of unevenly distributed points. In this paper, we propose a novel method for obtaining semantic labels of airborne laser scanning (ALS) point clouds involving the embedding of local context information for each point with multi-scale deep learning, nonlinear manifold learning for feature dimension reduction, and global graph-based optimization for refining the classification results. Specifically, we address the tasks of learning discriminative features and global labeling smoothing. The key contribution of our study is threefold. First, a hierarchical data augmentation strategy is applied to enhance the learning of deep features based on the PointNet++ network and simultaneously eliminate the artifacts caused by division and sampling while dealing with large-scale datasets. Subsequently, the learned hierarchical deep features are globally optimized and embedded into a low-dimensional space with a nonlinear manifold-based joint learning method with the removal of redundant and disturbing information. Finally, a graph-structured optimization based on the Markov random fields algorithm is performed to achieve global optimization of the initial classification results that are obtained using the embedded deep features by constructing a weighted indirect graph and solving the optimization problem with graph-cuts. We conducted thorough experiments on ALS point cloud datasets to assess the performance of our framework. Results indicate that compared to other commonly used advanced classification methods, our method can achieve high classification accuracy. The overall accuracy (OA) of our approach on the ISPRS benchmark dataset can scale up to 83.2% for classifying nine semantic classes, thereby outperforming other compared point-based strategies. Additionally, we evaluated our framework on a selected portion of the AHN3 dataset, which provided OA up to 91.2%.</p>

Semantic Labeling of ALS Point Cloud Via Learning Voxel and Pixel Representations

From Virtuality To Reality: A Learning-based Point Cloud Labeling Method With Synthesis Scene

ALS Point Cloud Classification by Integrating an Improved Fully Convolutional Network into Transfer Learning with Multi-Scale and Multi-View Deep Features

A Deep Neural Network Using Double Self-Attention Mechanism for ALS Point Cloud Segmentation

Deep point embedding for urban classification using ALS point clouds: A new perspective from local to global

WEAKLY SUPERVISED PSEUDO-LABEL ASSISTED LEARNING FOR ALS POINT CLOUD SEMANTIC SEGMENTATION

Classification of Airborne Laser Scanning Point Cloud Using Point-Based Convolutional Neural Network

Semantic Segmentation of Airborne LiDAR Point Clouds With Noisy Labels

Semantic Segmentation of Urban Airborne LiDAR Point Clouds Based on Fusion Attention Mechanism and Multi-Scale Features

PointNet++ Network Architecture with Individual Point Level and Global Features on Centroid for ALS Point Cloud Classification

Hybrid CNN-LSTM Architecture for LiDAR Point Clouds Semantic Segmentation

Large-scale point cloud semantic segmentation via local perception and global descriptor vector

A LiDAR Point Cloud Semantic Segmentation Algorithm Based on Attention Mechanism and Hybrid CNN-LSTM

Large-scale ALS Data Semantic Classification Integrating Location-Context-Semantics Cues by Higher-Order CRF

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Semantic Segmentation of LiDAR Point Cloud Based on CAFF-PointNet

Large-Scale ALS Point Cloud Segmentation via Projection-Based Context Embedding

Sparse Single Sweep LiDAR Point Cloud Segmentation Via Learning Contextual Shape Priors from Scene Completion

LACV-Net: Semantic Segmentation of Large-Scale Point Cloud Scene via Local Adaptive and Comprehensive VLAD

Fast Context-Awareness Encoder for LiDAR Point Semantic Segmentation

SVQNet: Sparse Voxel-Adjacent Query Network for 4D Spatio-Temporal LiDAR Semantic Segmentation