Abstract:Autonomous vehicle perception systems typically rely on single-wavelength lidar sensors to obtain three-dimensional information about the road environment. In contrast to cameras, lidars are unaffected by challenging illumination conditions, such as low light during night-time and various bidirectional effects changing the return reflectance. However, as many commercial lidars operate on a monochromatic basis, the ability to distinguish objects based on material spectral properties is limited. In this work, we describe the prototype hardware for a hyperspectral single photon lidar and demonstrate the feasibility of its use in an autonomous-driving-related object classification task. We also introduce a simple statistical model for estimating the reflectance measurement accuracy of single photon sensitive lidar devices. The single photon receiver frame was used to receive 30 12.3 nm spectral channels in the spectral band 1200–1570 nm, with a maximum channel-wise intensity of 32 photons. A varying number of frames were used to accumulate the signal photon count. Multiple objects covering 10 different categories of road environment, such as car, dry asphalt, gravel road, snowy asphalt, wet asphalt, wall, granite, grass, moss, and spruce tree, were included in the experiments. We test the influence of the number of spectral channels and the number of frames on the classification accuracy with random forest classifier and find that the spectral information increases the classification accuracy in the high-photon flux regime from 50% to 94% with 2 channels and 30 channels, respectively. In the low-photon flux regime, the classification accuracy increases from 30% to 38% with 2 channels and 6 channels, respectively. Additionally, we visualize the data with the t-SNE algorithm and show that the photon shot noise in the single photon sensitive hyperspectral data contributes the most to the separability of material specific spectral signatures. The results of this study provide support for the use of hyperspectral single photon lidar data on more advanced object detection and classification methods, and motivates the development of advanced single photon sensitive hyperspectral lidar devices for use in autonomous vehicles and in robotics.

Distance Measurement of Low Reflectance Objects Using Indirect Time of Flight LiDAR

Intelligent Liquid Surface Measuring System Based on Laser Ranging

Optical and Mechanical Design of a Laser-Based Non-Intrusive Vehicle Delineation Detection System

Remote measurement of surface roughness, surface reflectance, and body reflectance with LiDAR

Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Study on the Near-IR Light Detection and Ranging (LiDAR) Potential Use as Water Level Sensor

Low Intensity LiDAR using Compressed Sensing and a Photon Number Resolving Detector

Experimental review of distance sensors for indoor mapping

Metasurface-enhanced light detection and ranging technology

Long-Range Imaging LiDAR with Multiple Denoising Technologies

Assessing the Robustness of LiDAR, Radar and Depth Cameras Against Ill-Reflecting Surfaces in Autonomous Vehicles: An Experimental Study

DTOF Image LiDAR With Stray Light Suppression and Equivalent Sampling Technology

Airborne Single-Photon LiDAR Towards a Small-Sized and Low-Power Payload

12.5-m Distance Measurement in High-Interference Environment Using Ultrasonic Array Sensors

Laser and LIDAR in a System for Visibility Distance Estimation in Fog Conditions

Rancang Bangun Alat Ukur Jarak dan Peringatan pada Visual Docking Guidance System menggunakan Sensor Lidar

A Novel Cycloidal Scanning LiDAR Sensor Using Risley Prism and Optical Orthogonal Frequency-Division Multiple Access for Aerial Applications

Investigation of Anti-Interference Characteristics of Frequency-Hopping LiDAR

Feasibility of Hyperspectral Single Photon Lidar for Robust Autonomous Vehicle Perception

Dtof LIDAR System Using Addressable Multi-Channel VCSEL Transmitter, 128x80 SPAD Sensor, and ML-Based Object Detection for Adaptive Beam-Steering

Detection and Tracking of Moving Objects Using a Roadside LiDAR System