Abstract:Autonomous vehicle perception systems typically rely on single-wavelength lidar sensors to obtain three-dimensional information about the road environment. In contrast to cameras, lidars are unaffected by challenging illumination conditions, such as low light during night-time and various bidirectional effects changing the return reflectance. However, as many commercial lidars operate on a monochromatic basis, the ability to distinguish objects based on material spectral properties is limited. In this work, we describe the prototype hardware for a hyperspectral single photon lidar and demonstrate the feasibility of its use in an autonomous-driving-related object classification task. We also introduce a simple statistical model for estimating the reflectance measurement accuracy of single photon sensitive lidar devices. The single photon receiver frame was used to receive 30 12.3 nm spectral channels in the spectral band 1200–1570 nm, with a maximum channel-wise intensity of 32 photons. A varying number of frames were used to accumulate the signal photon count. Multiple objects covering 10 different categories of road environment, such as car, dry asphalt, gravel road, snowy asphalt, wet asphalt, wall, granite, grass, moss, and spruce tree, were included in the experiments. We test the influence of the number of spectral channels and the number of frames on the classification accuracy with random forest classifier and find that the spectral information increases the classification accuracy in the high-photon flux regime from 50% to 94% with 2 channels and 30 channels, respectively. In the low-photon flux regime, the classification accuracy increases from 30% to 38% with 2 channels and 6 channels, respectively. Additionally, we visualize the data with the t-SNE algorithm and show that the photon shot noise in the single photon sensitive hyperspectral data contributes the most to the separability of material specific spectral signatures. The results of this study provide support for the use of hyperspectral single photon lidar data on more advanced object detection and classification methods, and motivates the development of advanced single photon sensitive hyperspectral lidar devices for use in autonomous vehicles and in robotics.

Near-Infrared Reflective Dark-Tone Bilayer System for LiDAR-Based Autonomous Vehicles

Optical and Mechanical Design of a Laser-Based Non-Intrusive Vehicle Delineation Detection System

Optical and Electronic Design for a Field Prototype of a Laser-Based Vehicle Delineation Detection System

White paper on LiDAR performance against selected Automotive Paints

Enhancing LiDAR Reliability Through Utilization of Premium Road Marking Materials

Investigation of Automotive LiDAR Vision in Rain from Material and Optical Perspectives

3D Vehicle Detection Using Cheap LiDAR and Camera Sensors.

Feasibility of Hyperspectral Single Photon Lidar for Robust Autonomous Vehicle Perception

Quantum Efficiency Enhancement in Si Avalanche Photodiodes in the NIR Regime Via Surface Texturing Towards Autonomous Driving Applications

Remote measurement of surface roughness, surface reflectance, and body reflectance with LiDAR

Software-Defined Active LiDARs for Autonomous Driving: A Parallel Intelligence-Based Adaptive Model

Designing Novel LiDAR-Detectable Plate-Type Materials: Synthesis, Chemistry, and Practical Application for Autonomous Working Environment

Adversarial Objects Against LiDAR-Based Autonomous Driving Systems

Single-Photon Avalanche Diode with Enhanced NIR-Sensitivity for Automotive LIDAR Systems

Dtof LIDAR System Using Addressable Multi-Channel VCSEL Transmitter, 128x80 SPAD Sensor, and ML-Based Object Detection for Adaptive Beam-Steering

Design and simulation of a near-infrared enhanced Si-based SPAD for an automotive LiDAR

Longitudinal Degradation of Pavement Marking Detectability for Mobile LiDAR Sensing Technology in Real-World Use

White paper on Selected Environmental Parameters affecting Autonomous Vehicle (AV) Sensors

Optimizing Lane Departure Warning System Towards AI-Centered Autonomous Vehicles

Compact infrared imaging lidar system for obstacle detection and mapping in sensor fusion

Nanophotonics for light detection and ranging technology