Abstract:Autonomous driving systems (ADSs) are capable of sensing the environment and making driving decisions autonomously. These systems are safety-critical, and testing them is one of the important approaches to ensure their safety. However, due to the inherent complexity of ADSs and the high dimensionality of their operating environment, the number of possible test scenarios for ADSs is infinite. Besides, the operating environment of ADSs is dynamic, continuously evolving, and full of uncertainties, which requires a testing approach adaptive to the environment. In addition, existing ADS testing techniques have limited effectiveness in ensuring the realism of test scenarios, especially the realism of weather conditions and their changes over time. Recently, reinforcement learning (RL) has demonstrated great potential in addressing challenging problems, especially those requiring constant adaptations to dynamic environments. To this end, we present DeepQTest, a novel ADS testing approach that uses RL to learn environment configurations with a high chance of revealing abnormal ADS behaviors. Specifically, DeepQTest employs Deep Q-Learning and adopts three safety and comfort measures to construct the reward functions. To ensure the realism of generated scenarios, DeepQTest defines a set of realistic constraints and introduces real-world weather conditions into the simulated environment. We employed three comparison baselines, i.e., random, greedy, and a state-of-the-art RL-based approach DeepCOllision, for evaluating DeepQTest on an industrial-scale ADS. Evaluation results show that DeepQTest demonstrated significantly better effectiveness in terms of generating scenarios leading to collisions and ensuring scenario realism compared with the baselines. In addition, among the three reward functions implemented in DeepQTest, Time-To-Collision is recommended as the best design according to our study.

ADEPT: A Testing Platform for Simulated Autonomous Driving.

DriveTester: A Unified Platform for Simulation-Based Autonomous Driving Testing

Accelerated Verification of Autonomous Driving Systems Based on Adaptive Subset Simulation

LMM-enhanced Safety-Critical Scenario Generation for Autonomous Driving System Testing From Non-Accident Traffic Videos

Testing of Autonomous Driving Systems: Where Are We and Where Should We Go?

DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars

LiRTest: Augmenting LiDAR Point Clouds for Automated Testing of Autonomous Driving Systems

SimADFuzz: Simulation-Feedback Fuzz Testing for Autonomous Driving Systems

Perception-Guided Fuzzing for Simulated Scenario-Based Testing of Autonomous Driving Systems

SAFR-AV: Safety Analysis of Autonomous Vehicles using Real World Data -- An end-to-end solution for real world data driven scenario-based testing for pre-certification of AV stacks

AADS: Augmented autonomous driving simulation using data-driven algorithms

A Digital Twin-based Testing and Data Collection System for Autonomous Driving in Extreme Traffic Scenarios

Safety assessment of highly automated driving systems in test tracks: A new framework.

A Survey on Autonomous Driving System Simulators

A Survey on Automated Driving System Testing: Landscapes and Trends

Parameter-Based Testing and Debugging of Autonomous Driving Systems

A Driver-Vehicle Model for ADS Scenario-based Testing

DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data

A Sequential Metamorphic Testing Framework for Understanding Automated Driving Systems

When Simulator Meets Natural Deviation: A Study on Deviations in Simulation-based ADS Testing