A Safety-Adapted Loss for Pedestrian Detection in Automated Driving

Maria Lyssenko,Piyush Pimplikar,Maarten Bieshaar,Farzad Nozarian,Rudolph Triebel
2024-02-05
Abstract:In safety-critical domains like automated driving (AD), errors by the object detector may endanger pedestrians and other vulnerable road users (VRU). As common evaluation metrics are not an adequate safety indicator, recent works employ approaches to identify safety-critical VRU and back-annotate the risk to the object detector. However, those approaches do not consider the safety factor in the deep neural network (DNN) training process. Thus, state-of-the-art DNN penalizes all misdetections equally irrespective of their criticality. Subsequently, to mitigate the occurrence of critical failure cases, i.e., false negatives, a safety-aware training strategy might be required to enhance the detection performance for critical pedestrians. In this paper, we propose a novel safety-aware loss variation that leverages the estimated per-pedestrian criticality scores during training. We exploit the reachability set-based time-to-collision (TTC-RSB) metric from the motion domain along with distance information to account for the worst-case threat quantifying the criticality. Our evaluation results using RetinaNet and FCOS on the nuScenes dataset demonstrate that training the models with our safety-aware loss function mitigates the misdetection of critical pedestrians without sacrificing performance for the general case, i.e., pedestrians outside the safety-critical zone.
Machine Learning,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The paper addresses the issue of pedestrian detection in autonomous driving, particularly the potential danger caused by false alarms in safety-critical areas. The current evaluation metrics are not sufficient to reflect safety concerns. Therefore, the paper proposes a new safety-adaptive loss function that considers the estimated level of danger for each pedestrian and quantifies the threat by incorporating both temporal collision and distance information. This approach strengthens the contribution of losses for high-risk pedestrians, improving their detection performance without sacrificing detection accuracy for pedestrians in general scenarios (non-safety-critical areas). The experiments show that using this safety-adaptive loss function can reduce false alarms for pedestrians in safety-critical areas while maintaining overall detection performance stability.