Abstract:<p>Semantic interpretation of the 3D scene is one of the most challenging problems in point cloud processing, which also deems as an essential task in a wide variety of point cloud applications. The core task of semantic interpretation is semantic labeling, namely, obtaining a unique semantic label for each point in the point cloud. Despite several reported approaches, semantic labeling continues to be a challenge owing to the complexity of scenes, objects of various scales, and the non-homogeneity of unevenly distributed points. In this paper, we propose a novel method for obtaining semantic labels of airborne laser scanning (ALS) point clouds involving the embedding of local context information for each point with multi-scale deep learning, nonlinear manifold learning for feature dimension reduction, and global graph-based optimization for refining the classification results. Specifically, we address the tasks of learning discriminative features and global labeling smoothing. The key contribution of our study is threefold. First, a hierarchical data augmentation strategy is applied to enhance the learning of deep features based on the PointNet++ network and simultaneously eliminate the artifacts caused by division and sampling while dealing with large-scale datasets. Subsequently, the learned hierarchical deep features are globally optimized and embedded into a low-dimensional space with a nonlinear manifold-based joint learning method with the removal of redundant and disturbing information. Finally, a graph-structured optimization based on the Markov random fields algorithm is performed to achieve global optimization of the initial classification results that are obtained using the embedded deep features by constructing a weighted indirect graph and solving the optimization problem with graph-cuts. We conducted thorough experiments on ALS point cloud datasets to assess the performance of our framework. Results indicate that compared to other commonly used advanced classification methods, our method can achieve high classification accuracy. The overall accuracy (OA) of our approach on the ISPRS benchmark dataset can scale up to 83.2% for classifying nine semantic classes, thereby outperforming other compared point-based strategies. Additionally, we evaluated our framework on a selected portion of the AHN3 dataset, which provided OA up to 91.2%.</p>

Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud

Discriminative-Dictionary-Learning-Based Multilevel Point-Cluster Features for ALS Point-Cloud Classification

AN EFFICIENT DEEP LEARNING APPROACH FOR GROUND POINT FILTERING IN AERIAL LASER SCANNING POINT CLOUDS

ALS Point Cloud Classification by Integrating an Improved Fully Convolutional Network into Transfer Learning with Multi-Scale and Multi-View Deep Features

Deep point embedding for urban classification using ALS point clouds: A new perspective from local to global

Hierarchical Aggregated Deep Features for ALS Point Cloud Classification

A Multilevel Point-Cluster-Based Discriminative Feature for Als Point Cloud Classification

DEM Extraction from ALS Point Clouds in Forest Areas Via Graph Convolution Network

A Three-Step Approach for TLS Point Cloud Classification.

LiDAR Data Classification Using Spatial Transformation and CNN

Airborne LiDAR Point Cloud Classification Using Ensemble Learning for DEM Generation

Tree Species Classification of Point Clouds from Different Laser Sensors Using the PointNet++ Deep Learning Method

Classification of Airborne Laser Scanning Point Cloud Using Point-Based Convolutional Neural Network

ALS Point Cloud Classification with Small Training Data Set Based on Transfer Learning

A Wavelet Based Algorithm For Dtm Extraction From Airborne Laser Scanning Data

A Method of Point Cloud Classification Using Multi-scale Dimensionality Features and Transductive Learning

Classification of LiDAR Point Clouds Using Supervoxel-Based Detrended Feature and Perception-Weighted Graphical Model.

High-Resolution Terrain Modeling Using Airborne LiDAR Data with Transfer Learning

A Single Point-Based Multilevel Features Fusion and Pyramid Neighborhood Optimization Method for ALS Point Cloud Classification

A FEATURE-BASED DEEP LEARNING APPROACH FOR THE EXTRACTION OF GROUND POINTS FROM 3D POINT CLOUDS

A Comparison of Deep Learning Methods for Airborne Lidar Point Clouds Classification