Abstract:Autonomous vehicle perception systems typically rely on single-wavelength lidar sensors to obtain three-dimensional information about the road environment. In contrast to cameras, lidars are unaffected by challenging illumination conditions, such as low light during night-time and various bidirectional effects changing the return reflectance. However, as many commercial lidars operate on a monochromatic basis, the ability to distinguish objects based on material spectral properties is limited. In this work, we describe the prototype hardware for a hyperspectral single photon lidar and demonstrate the feasibility of its use in an autonomous-driving-related object classification task. We also introduce a simple statistical model for estimating the reflectance measurement accuracy of single photon sensitive lidar devices. The single photon receiver frame was used to receive 30 12.3 nm spectral channels in the spectral band 1200–1570 nm, with a maximum channel-wise intensity of 32 photons. A varying number of frames were used to accumulate the signal photon count. Multiple objects covering 10 different categories of road environment, such as car, dry asphalt, gravel road, snowy asphalt, wet asphalt, wall, granite, grass, moss, and spruce tree, were included in the experiments. We test the influence of the number of spectral channels and the number of frames on the classification accuracy with random forest classifier and find that the spectral information increases the classification accuracy in the high-photon flux regime from 50% to 94% with 2 channels and 30 channels, respectively. In the low-photon flux regime, the classification accuracy increases from 30% to 38% with 2 channels and 6 channels, respectively. Additionally, we visualize the data with the t-SNE algorithm and show that the photon shot noise in the single photon sensitive hyperspectral data contributes the most to the separability of material specific spectral signatures. The results of this study provide support for the use of hyperspectral single photon lidar data on more advanced object detection and classification methods, and motivates the development of advanced single photon sensitive hyperspectral lidar devices for use in autonomous vehicles and in robotics.

Single-photon detection approach for autonomous vehicles sensing

Optical and Mechanical Design of a Laser-Based Non-Intrusive Vehicle Delineation Detection System

Optical and Electronic Design for a Field Prototype of a Laser-Based Vehicle Delineation Detection System

Optimization of System Design and Calibration Algorithm for SPAD-Based LiDAR Imager

Ultra-low power anti-crosstalk collision avoidance light detection and ranging using chaotic pulse position modulation approach*

Dtof LIDAR System Using Addressable Multi-Channel VCSEL Transmitter, 128x80 SPAD Sensor, and ML-Based Object Detection for Adaptive Beam-Steering

Guided Direct Time-of-Flight Lidar Using Stereo Cameras for Enhanced Laser Power Efficiency

Feasibility of Hyperspectral Single Photon Lidar for Robust Autonomous Vehicle Perception

A Novel Cppm Anti-Crosstalk Collision Avoidance Lidar with Ultra-Low Laser Power

Long-range all-solid-state flash LiDAR sensor for autonomous driving

Toward Intelligent Sensing: Optimizing Lidar Beam Distribution for Autonomous Driving

Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection

Solid-State Dtof LiDAR System Using an Eight-Channel Addressable, 20w/ch Transmitter, and a 128x128 SPAD Receiver with SNR-Based Pixel Binning and Resolution Upscaling.

Emerging single-photon detection technique for high-performance photodetector

Target Detection in Challenging Environments: Photonic Radar with a Hybrid Multiplexing Scheme for 5G Autonomous Vehicles

An Ultrasensitive Bi2O2Se/In2S3 Photodetector with Low Detection Limit and Fast Response toward High-Precision Unmanned Driving

Detecting and Identifying Optical Signal Attacks on Autonomous Driving Systems

Omni-directional Detection and Tracking of On-Road Vehicles Using Multiple Horizontal Laser Scanners

Dynamic Obstacle Detection and Representation Approach for Unmanned Vehicles Based on Laser Sensor

Pixel Multiplexing Technique For Real-Time Three-Dimensional-Imaging Laser Detection And Ranging System Using Four Linear-Mode Avalanche Photodiodes

Development and Field Testing of Laser Photodiode Array-Based Vehicle Detection Systems