A Lightweight VK-Net Based on Motion Profiles for Hazardous Driving Scenario Identification

Zhen Gao,Jingning Xu,Jiang Yu Zheng,Hongfei Fan,Rongjie Yu,Jiaqi Zong,Xinyi Li
DOI: https://doi.org/10.1109/hpcc-dss-smartcity-dependsys53884.2021.00145
2021-01-01
Abstract:Hazardous driving scenarios are critical for the development and testing of highly autonomous vehicles. Recent studies have proposed new approaches for extracting hazardous scenarios from driving videos, which greatly improve the detection accuracy compared with traditional approaches that extract information from structured kinematic data. However, direct processing on driving videos is costly, and the videos need to be uploaded and processed in a centralized manner. In this study, we propose a novel approach for reducing the cost of video analysis while maintaining high accuracy in hazardous scenario identification. Firstly, the videos are significantly compressed into motion profile images that contain motion trajectories of objects. Secondly, a lightweight CNN with attention mechanism has been designed to extract risky trajectory features of the conflicting traffic objects. Furthermore, data augmentation has been applied to increase the generalizability of the model. The proposed approach achieves significantly lightweight network size, and meanwhile, experimental results have demonstrated that the approach achieves high accuracy with sensitivity 0.95, specificity 0.85 and AUC 0.95, which outperforms state-of-the-art hazardous scenario identification approaches. The efficient execution of identification implies that it is suitable to be distributed and deployed at each vehicle, and consequently, videos could be processed via edge computing, which would improve the diversity of hazardous scenarios and the efficiency of scenario collection for further research work.
What problem does this paper attempt to address?