Abstract:Autonomous driving systems (ADSs) are capable of sensing the environment and making driving decisions autonomously. These systems are safety-critical, and testing them is one of the important approaches to ensure their safety. However, due to the inherent complexity of ADSs and the high dimensionality of their operating environment, the number of possible test scenarios for ADSs is infinite. Besides, the operating environment of ADSs is dynamic, continuously evolving, and full of uncertainties, which requires a testing approach adaptive to the environment. In addition, existing ADS testing techniques have limited effectiveness in ensuring the realism of test scenarios, especially the realism of weather conditions and their changes over time. Recently, reinforcement learning (RL) has demonstrated great potential in addressing challenging problems, especially those requiring constant adaptations to dynamic environments. To this end, we present DeepQTest, a novel ADS testing approach that uses RL to learn environment configurations with a high chance of revealing abnormal ADS behaviors. Specifically, DeepQTest employs Deep Q-Learning and adopts three safety and comfort measures to construct the reward functions. To ensure the realism of generated scenarios, DeepQTest defines a set of realistic constraints and introduces real-world weather conditions into the simulated environment. We employed three comparison baselines, i.e., random, greedy, and a state-of-the-art RL-based approach DeepCOllision, for evaluating DeepQTest on an industrial-scale ADS. Evaluation results show that DeepQTest demonstrated significantly better effectiveness in terms of generating scenarios leading to collisions and ensuring scenario realism compared with the baselines. In addition, among the three reward functions implemented in DeepQTest, Time-To-Collision is recommended as the best design according to our study.

Deeply Reinforcing Android GUI Testing with Deep Reinforcement Learning.

Deep Reinforcement Learning for Black-Box Testing of Android Apps

A reinforcement learning-based approach to testing GUI of moblie applications

Reinforcement Learning Based Curiosity-Driven Testing of Android Applications

DinoDroid: Testing Android Apps Using Deep Q-Networks

UniRLTest: Universal Platform-Independent Testing with Reinforcement Learning Via Image Understanding

Effective, Platform-Independent GUI Testing via Image Embedding and Reinforcement Learning

Practical GUI Testing of Android Applications Via Model Abstraction and Refinement

DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data

Accelerating Automated Android GUI Exploration with Widgets Grouping

Enhancing GUI Exploration Coverage of Android Apps with Deep Link-Integrated Monkey

Augmenting Automated Game Testing with Deep Reinforcement Learning

A Context-Aware Approach for Dynamic GUI Testing of Android Applications.

Reinforcement Learning-Driven Test Generation for Android GUI Applications using Formal Specifications

Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing.

Q uo T e : Quality-oriented Testing for Deep Learning Systems

CamDroid: Context-Aware Model-Based Automated GUI Testing for Android Apps

Humanoid: A Deep Learning-based Approach to Automated Black-box Android App Testing

Practical Non-Intrusive GUI Exploration Testing with Visual-based Robotic Arms

State of the Art Control of Atari Games Using Shallow Reinforcement Learning