Abstract:Precise classification of Light Detection and Ranging (LiDAR) point cloud is a fundamental process in various applications, such as land cover mapping, forestry management, and autonomous driving. Due to the lack of spectral information, the existing research on single wavelength LiDAR classification is limited. Spectral information from images could address this limitation, but data fusion suffers from varying illumination conditions and the registration problem. A novel multispectral LiDAR successfully obtains spatial and spectral information as a brand-new data type, namely, multispectral point cloud, thereby improving classification performance. However, spatial and spectral information of multispectral LiDAR has been processed separately in previous studies, thereby possibly limiting the classification performance of multispectral LiDAR. To explore the potential of this new data type, the current spatial–spectral classification framework for multispectral LiDAR that includes four steps: (1) neighborhood selection, (2) feature extraction and selection, (3) classification, and (4) label smoothing. Three novel highlights were proposed in this spatial – spectral classification framework. (1) We improved the popular eigen entropy-based neighborhood selection by spectral angle match to extract a more precise neighborhood. (2) We evaluated the importance of geometric and spectral features to compare their contributions and selected the most important features to reduce feature redundancy. (3) We conducted spatial label smoothing by a conditional random field, accounting for the spatial and spectral information of the neighborhood points. The proposed method demonstrated by a multispectral LiDAR with three channels: 466 nm (blue), 527 nm (green), and 628 nm (red). Experimental results demonstrate the effectiveness of the proposed spatial – spectral classification framework. Moreover, this research takes advantages of the complementation of spatial and spectral information, which could benefit more precise neighborhood selection, more effective features, and satisfactory refinement of classification result. Finally, this study could serve as an inspiration for future efficient spatial–spectral process for multispectral point cloud.

Geometric-Spectral Reconstruction Learning for Multi-Source Open-Set Classification With Hyperspectral and LiDAR Data

Spectral-Spatial Latent Reconstruction for Open-Set Hyperspectral Image Classification

Deep Feature Reconstruction Learning for Open-Set Classification of Remote Sensing Imagery

A spatial–spectral classification framework for multispectral LiDAR

A SAR Open-Set Recognition Method Aided by Hierarchically Reconstructive Latent Representation Learning

Spatial-spectral Hyperspectral Image Classification Based on Information Measurement and CNN

GASSF-Net: Geometric Algebra Based Spectral-Spatial Hierarchical Fusion Network for Hyperspectral and LiDAR Image Classification

Spectral-Spatial Evidential Learning Network for Open-Set Hyperspectral Image Classification

Feature Learning Using Spatial-Spectral Hypergraph Discriminant Analysis for Hyperspectral Image.

Exploring Reinforced Class Separability and Discriminative Representations for SAR Target Open Set Recognition

A Learnable Joint Spatial and Spectral Transformation for High Resolution Remote Sensing Image Retrieval

Hyperspectral Image Classification Based on Semisupervised Self-Learning and Multiview Information Fusion

Incremental Learning With Open-Set Recognition for Remote Sensing Image Scene Classification

Deep Learning Classification by ResNet-18 Based on the Real Spectral Dataset from Multispectral Remote Sensing Images

Spectral-Spatial Discriminant Feature Learning For Hyperspectral Image Classification

MS2CANet: Multiscale Spatial–Spectral Cross-Modal Attention Network for Hyperspectral Image and LiDAR Classification

Time Series Remote Sensing Image Classification Using Feature Relationship Learning

A Trusted Generative-Discriminative Joint Feature Learning Framework for Remote Sensing Image Classification

Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data

Hyperspectral image spectral–spatial classification using local tensor discriminant feature extraction

Electromagnetic Scattering Kernel Guided Reciprocal Point Learning for SAR Open-Set Recognition