Abstract:<p>Semantic interpretation of the 3D scene is one of the most challenging problems in point cloud processing, which also deems as an essential task in a wide variety of point cloud applications. The core task of semantic interpretation is semantic labeling, namely, obtaining a unique semantic label for each point in the point cloud. Despite several reported approaches, semantic labeling continues to be a challenge owing to the complexity of scenes, objects of various scales, and the non-homogeneity of unevenly distributed points. In this paper, we propose a novel method for obtaining semantic labels of airborne laser scanning (ALS) point clouds involving the embedding of local context information for each point with multi-scale deep learning, nonlinear manifold learning for feature dimension reduction, and global graph-based optimization for refining the classification results. Specifically, we address the tasks of learning discriminative features and global labeling smoothing. The key contribution of our study is threefold. First, a hierarchical data augmentation strategy is applied to enhance the learning of deep features based on the PointNet++ network and simultaneously eliminate the artifacts caused by division and sampling while dealing with large-scale datasets. Subsequently, the learned hierarchical deep features are globally optimized and embedded into a low-dimensional space with a nonlinear manifold-based joint learning method with the removal of redundant and disturbing information. Finally, a graph-structured optimization based on the Markov random fields algorithm is performed to achieve global optimization of the initial classification results that are obtained using the embedded deep features by constructing a weighted indirect graph and solving the optimization problem with graph-cuts. We conducted thorough experiments on ALS point cloud datasets to assess the performance of our framework. Results indicate that compared to other commonly used advanced classification methods, our method can achieve high classification accuracy. The overall accuracy (OA) of our approach on the ISPRS benchmark dataset can scale up to 83.2% for classifying nine semantic classes, thereby outperforming other compared point-based strategies. Additionally, we evaluated our framework on a selected portion of the AHN3 dataset, which provided OA up to 91.2%.</p>

Research on deep learning-based point cloud semantic segmentation for offshore drilling platforms

Deep Learning-Based Semantic Segmentation and Surface Reconstruction for Point Clouds of Offshore Oil Production Equipment

3D Semantic Segmentation Using Deep Learning for Large-Scale Indoor Point Cloud

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

Semantic Segmentation of Aerial Laser Point Clouds Based on Deep-Residual Enhanced Coding of Multi-Feature Information

A Semantic Segmentation Approach Based On Deeplab Network In High-Resolution Remote Sensing Images

Sea-Land Segmentation Using Deep Learning Techniques for Landsat-8 OLI Imagery

Deep-Learning-Based Point Cloud Semantic Segmentation: A Survey

Semantic Segmentation of Coastal Zone on Airborne Lidar Bathymetry Point Clouds

Semantic Segmentation of Substation Site Cloud Based on Seg-PointNet

PointDMS: An Improved Deep Learning Neural Network via Multi-Feature Aggregation for Large-Scale Point Cloud Segmentation in Smart Applications of Urban Forestry Management

A New Semantic Segmentation Method of Point Cloud Based on PointNet and VoxelNet

3D Semantic Segmentation of Large-Scale Point-Clouds in Urban Areas Using Deep Learning

Deep-Learning-Based Semantic Segmentation Approach for Point Clouds of Extra-High-Voltage Transmission Lines

Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation From LiDAR Point Clouds in Large-Scale Environments

A Deep Learning-Based Method for Overhead Contact System Component Recognition Using Mobile 2D LiDAR

Instance Segmentation of Sparse Point Clouds with Spatio-Temporal Coding for Autonomous Robot

Deep point embedding for urban classification using ALS point clouds: A new perspective from local to global

A Pre-Procession Module for Point-Based Deep Learning in Dense Point Clouds in the Ship Engineering Field

Semantic Segmentation of 3D Point Clouds Based on High Precision Range Search Network

Exploring Semantic Information Extraction From Different Data Forms in 3D Point Cloud Semantic Segmentation