Abstract:<p>Point cloud classification plays an important role in a wide range of airborne light detection and ranging (LiDAR) applications, such as topographic mapping, forest monitoring, power line detection, and road detection. However, due to the sensor noise, high redundancy, incompleteness, and complexity of airborne LiDAR systems, point cloud classification is challenging. Traditional point cloud classification methods mostly focus on the development of handcrafted point geometry features and employ machine learning-based classification models to conduct point classification. In recent years, the advances of deep learning models have caused researchers to shift their focus towards machine learning-based models, specifically deep neural networks, to classify airborne LiDAR point clouds. These learning-based methods start by transforming the unstructured 3D point sets to regular 2D representations, such as collections of feature images, and then employ a 2D CNN for point classification. Moreover, these methods usually need to calculate additional local geometry features, such as planarity, sphericity and roughness, to make use of the local structural information in the original 3D space. Nonetheless, the 3D to 2D conversion results in information loss. In this paper, we propose a directionally constrained fully convolutional neural network (D-FCN) that can take the original 3D coordinates and LiDAR intensity as input; thus, it can directly apply to unstructured 3D point clouds for semantic labeling. Specifically, we first introduce a novel directionally constrained point convolution (D-Conv) module to extract locally representative features of 3D point sets from the projected 2D receptive fields. To make full use of the orientation information of neighborhood points, the proposed D-Conv module performs convolution in an orientation-aware manner by using a directionally constrained nearest neighborhood search. Then, we design a multiscale fully convolutional neural network with downsampling and upsampling blocks to enable multiscale point feature learning. The proposed D-FCN model can therefore process input point cloud with arbitrary sizes and directly predict the semantic labels for all the input points in an end-to-end manner. Without involving additional geometry features as input, the proposed method demonstrates superior performance on the International Society for Photogrammetry and Remote Sensing (ISPRS) 3D labeling benchmark dataset. The results show that our model achieves a new state-of-the-art performance on powerline, car, and facade categories. Moreover, to demonstrate the generalization abilities of the proposed method, we conduct further experiments on the 2019 Data Fusion Contest Dataset. Our proposed method achieves superior performance than the comparing methods and accomplishes an overall accuracy of 95.6% and an average F1 score of 0.810.</p>

Efficient long-range convolutions for point clouds

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

LRC-Net: Learning Discriminative Features on Point Clouds by Encoding Local Region Contexts

LSPConv: local spatial projection convolution for point cloud analysis

Long Range Pooling for 3D Large-Scale Scene Understanding

RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation

RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learning

Deep RBFNet: Point Cloud Feature Learning using Radial Basis Functions

Optimized CNNs for Rapid 3D Point Cloud Object Recognition

Towards Efficient Graph Convolutional Networks for Point Cloud Handling

FG-Net: A Fast and Accurate Framework for Large-Scale LiDAR Point Cloud Understanding

Flex-Convolution (Million-Scale Point-Cloud Learning Beyond Grid-Worlds)

RPV-CASNet: range-point-voxel integration with channel self-attention network for lidar point cloud segmentation

RGCNN: Regularized Graph CNN for Point Cloud Segmentation

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

Directionally constrained fully convolutional neural network for airborne LiDAR point cloud classification

NPTC-net: Narrow-Band Parallel Transport Convolutional Neural Network on Point Clouds

Context-based local-global fusion network for 3D point cloud classification and segmentation

Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognition

RepPVConv: attentively fusing reparameterized voxel features for efficient 3D point cloud perception