Detecting the Anomalies in LiDAR Pointcloud

Chiyu Zhang,Ji Han,Yao Zou,Kexin Dong,Yujia Li,Junchun Ding,Xiaoling Han
2023-08-01
Abstract:LiDAR sensors play an important role in the perception stack of modern autonomous driving systems. Adverse weather conditions such as rain, fog and dust, as well as some (occasional) LiDAR hardware fault may cause the LiDAR to produce pointcloud with abnormal patterns such as scattered noise points and uncommon intensity values. In this paper, we propose a novel approach to detect whether a LiDAR is generating anomalous pointcloud by analyzing the pointcloud characteristics. Specifically, we develop a pointcloud quality metric based on the LiDAR points' spatial and intensity distribution to characterize the noise level of the pointcloud, which relies on pure mathematical analysis and does not require any labeling or training as learning-based methods do. Therefore, the method is scalable and can be quickly deployed either online to improve the autonomy safety by monitoring anomalies in the LiDAR data or offline to perform in-depth study of the LiDAR behavior over large amount of data. The proposed approach is studied with extensive real public road data collected by LiDARs with different scanning mechanisms and laser spectrums, and is proven to be able to effectively handle various known and unknown sources of pointcloud anomaly.
Robotics,Computer Vision and Pattern Recognition,Signal Processing
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper aims to address the issue of point cloud anomalies generated by LiDAR under adverse weather conditions (such as rain, fog, dust) or hardware failures. Specifically, these anomalies include scattered noise points and uncommon intensity values. These issues not only affect the perception performance of autonomous driving systems but can also lead to incorrect decisions, thereby impacting safety. ### Background and Motivation LiDAR plays a crucial role in modern autonomous driving systems, capable of generating high-precision environmental point cloud data, unaffected by lighting conditions. However, under adverse weather conditions, LiDAR signals may be scattered or attenuated, resulting in random noise points and lower intensity readings in the point cloud data. Additionally, hardware failures or other unknown factors may also cause point cloud anomalies. These issues not only affect the system's perception capabilities but can also pose safety risks. ### Solution To address the aforementioned issues, the authors propose a new method to detect whether LiDAR has generated anomalous point clouds. This method is based on the spatial distribution and intensity distribution of the point cloud, developing a point cloud quality metric. This metric characterizes the noise level of the point cloud through pure mathematical analysis, requiring no annotations or training data, thus offering scalability and rapid deployment advantages. The method can monitor LiDAR data anomalies in real-time online, enhancing the safety of autonomous driving systems, and can also be used offline for in-depth research on large datasets. ### Main Contributions 1. **General Quality Metric**: This metric can capture point cloud anomalies related to noise, regardless of the cause of the anomaly. This is particularly useful for identifying new issues during early system validation or large-scale operations. 2. **No Need for Pre-Data Collection, Annotation, and Training**: This reduces the time and resource consumption in actual implementation. ### Validation The method was validated using over 10,000 miles of public road data collected by LiDARs with different scanning mechanisms and laser spectra. The results show that the method can effectively identify point clouds affected by adverse weather conditions or other uncommon noise sources (such as signal interference, road dust, etc.). ### Conclusion By proposing a quality metric based on the spatial distribution and intensity distribution of point clouds, this paper provides an effective method to detect LiDAR point cloud anomalies, thereby improving the safety and reliability of autonomous driving systems.