Abstract:Precise classification of Light Detection and Ranging (LiDAR) point cloud is a fundamental process in various applications, such as land cover mapping, forestry management, and autonomous driving. Due to the lack of spectral information, the existing research on single wavelength LiDAR classification is limited. Spectral information from images could address this limitation, but data fusion suffers from varying illumination conditions and the registration problem. A novel multispectral LiDAR successfully obtains spatial and spectral information as a brand-new data type, namely, multispectral point cloud, thereby improving classification performance. However, spatial and spectral information of multispectral LiDAR has been processed separately in previous studies, thereby possibly limiting the classification performance of multispectral LiDAR. To explore the potential of this new data type, the current spatial–spectral classification framework for multispectral LiDAR that includes four steps: (1) neighborhood selection, (2) feature extraction and selection, (3) classification, and (4) label smoothing. Three novel highlights were proposed in this spatial – spectral classification framework. (1) We improved the popular eigen entropy-based neighborhood selection by spectral angle match to extract a more precise neighborhood. (2) We evaluated the importance of geometric and spectral features to compare their contributions and selected the most important features to reduce feature redundancy. (3) We conducted spatial label smoothing by a conditional random field, accounting for the spatial and spectral information of the neighborhood points. The proposed method demonstrated by a multispectral LiDAR with three channels: 466 nm (blue), 527 nm (green), and 628 nm (red). Experimental results demonstrate the effectiveness of the proposed spatial – spectral classification framework. Moreover, this research takes advantages of the complementation of spatial and spectral information, which could benefit more precise neighborhood selection, more effective features, and satisfactory refinement of classification result. Finally, this study could serve as an inspiration for future efficient spatial–spectral process for multispectral point cloud.

A Traffic Sign Classification Method using LiDAR Corrected Intensity and Geometric Feature

An Efficient Framework for Detection and Recognition of Numerical Traffic Signs

LIDAR and vision-based real-time traffic sign detection and recognition algorithm for intelligent vehicle

Accurate detection of vehicle, pedestrian, cyclist and wheelchair from roadside light detection and ranging sensors

A Fusion Approach to Detect Traffic Signs Using Registered Color Images and Noisy Airborne LiDAR Data

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Traffic Sign Recognition from Digital Images by Using Deep Learning

The Improved Framework for Traffic Sign Recognition Using Guided Image Filtering

Traffic Sign Recognition With Lightweight Two-Stage Model in Complex Scenes

Traffic Sign Detection via Improved Sparse R-CNN for Autonomous Vehicles

Traffic sign extraction using deep hierarchical feature learning and mobile light detection and ranging (LiDAR) data on rural highways

Transformer Fusion and Residual Learning Group Classifier Loss for Long-Tailed Traffic Sign Detection

Study on Traffic Sign Recognition by Optimized Lenet-5 Algorithm

Research on Road Environmental Sense Method of Intelligent Vehicle Based on Tracking Check

A Traffic Sign Recognition Method Under Complex Illumination Conditions

Traffic Sign Based Point Cloud Data Registration with Roadside LiDARs in Complex Traffic Environments

A feature‐enhanced hybrid attention network for traffic sign recognition in real scenes

A spatial–spectral classification framework for multispectral LiDAR

A CNN-based Traffic Sign Detection and Classification Method Using Priori Knowledge

Improved Traffic Sign Detection and Recognition Algorithm for Intelligent Vehicles