Accelerated Testing and Evaluation of Autonomous Vehicles Based on Dual Surrogates

Jianfeng Wu,Xingyu Xing,Lu Xiong,Junyi Chen
DOI: https://doi.org/10.1007/s42154-023-00279-4
2024-01-01
Automotive Innovation
Abstract:Testing and evaluation plays a critical role in the research and development (R D) of autonomous vehicles (AVs). Due to the black-box property of AVs and the restraint of test resources, how to quickly test and evaluate AVs’ safety remains a major challenge. To address this problem, a novel search-based ADOE testing and evaluation method is proposed, which improves the efficiency of testing and evaluation through a two-stage acceleration. In Accelerated Testing stage, the proposed ADOE-based testing method (DUSGAT) is used to accelerate testing, which adopts dual surrogates (result surrogate M_R and behavior surrogate M_B ). This method indicates not only the previous searching results but also the behavior pattern of the system under test (SUT) during previous tests, to accelerate the whole process of unveiling all critical scenarios for the SUT. In the Accelerated Evaluation stage, the trained M_B is used to quickly predict and evaluate the safety performance of SUT in the logical scenario. Experimental results show that DUSGAT has the best search performance compared with baseline methods, and the F2-score of DUSGAT is higher than TuRBO. In the 2-dimensional car-following scenario, the relative error between the output SUT’s hazard ratio of our method and that of grid search is only 0.68
What problem does this paper attempt to address?