Abstract:<p>Point cloud classification plays an important role in a wide range of airborne light detection and ranging (LiDAR) applications, such as topographic mapping, forest monitoring, power line detection, and road detection. However, due to the sensor noise, high redundancy, incompleteness, and complexity of airborne LiDAR systems, point cloud classification is challenging. Traditional point cloud classification methods mostly focus on the development of handcrafted point geometry features and employ machine learning-based classification models to conduct point classification. In recent years, the advances of deep learning models have caused researchers to shift their focus towards machine learning-based models, specifically deep neural networks, to classify airborne LiDAR point clouds. These learning-based methods start by transforming the unstructured 3D point sets to regular 2D representations, such as collections of feature images, and then employ a 2D CNN for point classification. Moreover, these methods usually need to calculate additional local geometry features, such as planarity, sphericity and roughness, to make use of the local structural information in the original 3D space. Nonetheless, the 3D to 2D conversion results in information loss. In this paper, we propose a directionally constrained fully convolutional neural network (D-FCN) that can take the original 3D coordinates and LiDAR intensity as input; thus, it can directly apply to unstructured 3D point clouds for semantic labeling. Specifically, we first introduce a novel directionally constrained point convolution (D-Conv) module to extract locally representative features of 3D point sets from the projected 2D receptive fields. To make full use of the orientation information of neighborhood points, the proposed D-Conv module performs convolution in an orientation-aware manner by using a directionally constrained nearest neighborhood search. Then, we design a multiscale fully convolutional neural network with downsampling and upsampling blocks to enable multiscale point feature learning. The proposed D-FCN model can therefore process input point cloud with arbitrary sizes and directly predict the semantic labels for all the input points in an end-to-end manner. Without involving additional geometry features as input, the proposed method demonstrates superior performance on the International Society for Photogrammetry and Remote Sensing (ISPRS) 3D labeling benchmark dataset. The results show that our model achieves a new state-of-the-art performance on powerline, car, and facade categories. Moreover, to demonstrate the generalization abilities of the proposed method, we conduct further experiments on the 2019 Data Fusion Contest Dataset. Our proposed method achieves superior performance than the comparing methods and accomplishes an overall accuracy of 95.6% and an average F1 score of 0.810.</p>

Learning Discriminative Features by Covering Local Geometric Space for Point Cloud Analysis.

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

Point Cloud Domain Adaptation Via Masked Local 3D Structure Prediction

PointSCNet: Point Cloud Structure and Correlation Learning Based on Space Filling Curve-Guided Sampling

Learning Point Cloud Shapes with Geometric and Topological Structures.

Dynamic Graph CNN for Learning on Point Clouds

LRC-Net: Learning Discriminative Features on Point Clouds by Encoding Local Region Contexts

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

LSPConv: local spatial projection convolution for point cloud analysis

ScatterNet: Point Cloud Learning via Scatters

A Category-Contrastive Guided-Graph Convolutional Network Approach for the Semantic Segmentation of Point Clouds

SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation.

Point Cloud Deep Learning Network Based on Local Domain Multi-Level Feature

Spherical Interpolated Convolutional Network With Distance-Feature Density for 3-D Semantic Segmentation of Point Clouds

DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing

DenseKPNET: Dense Kernel Point Convolutional Neural Networks for Point Cloud Semantic Segmentation

Three-Dimensional Point Cloud Semantic Segmentation Network Based on Spatial Graph Convolution Network

Local Feature Extraction Network for Point Cloud Analysis

Context-based local-global fusion network for 3D point cloud classification and segmentation

Deep Neural Network for Point Sets Based on Local Feature Integration

Directionally constrained fully convolutional neural network for airborne LiDAR point cloud classification