Abstract:During the development of autonomous systems such as driverless cars, it is important to characterize the scenarios that are most likely to result in failure. Adaptive Stress Testing (AST) provides a way to search for the most-likely failure scenario as a Markov decision process (MDP). Our previous work used a deep reinforcement learning (DRL) solver to identify likely failure scenarios. However, the solver's use of a feed-forward neural network with a discretized space of possible initial conditions poses two major problems. First, the system is not treated as a black box, in that it requires analyzing the internal state of the system, which leads to considerable implementation complexities. Second, in order to simulate realistic settings, a new instance of the solver needs to be run for each initial condition. Running a new solver for each initial condition not only significantly increases the computational complexity, but also disregards the underlying relationship between similar initial conditions. We provide a solution to both problems by employing a recurrent neural network that takes a set of initial conditions from a continuous space as input. This approach enables robust and efficient detection of failures because the solution generalizes across the entire space of initial conditions. By simulating an instance where an autonomous car drives while a pedestrian is crossing a road, we demonstrate the solver is now capable of finding solutions for problems that would have previously been intractable.

Generating Environmental Models for Testing Self-adaptive Systems

Verifying Self-Adaptive Applications Suffering Uncertainty

Resynchronizing Model-Based Self-Adaptive Systems with Environments

Modeling and Specifying Parametric Adaptation Mechanism for Self-Adaptive Systems

A Proactive Self-Adaptation Approach for Software Systems Based on Environment-Aware Model Predictive Control

Active Monitoring Mechanism for Control-Based Self-Adaptive Systems

A Meta Reinforcement Learning-based Approach for Self-Adaptive System

An Adaptive Maintenance Model Oriented to Process Environment of the Manufacturing Systems

Survey of Model-Based Self-Adaptation Methods

Adaptive Testing Environment Generation for Connected and Automated Vehicles with Dense Reinforcement Learning

Planning Landscape Analysis for Self-Adaptive Systems

Environment Imitation: Data-Driven Environment Model Generation Using Imitation Learning for Efficient CPS Goal Verification

Verification Based Decision-Making for Self-Adaptive Systems: A Model-Driven Approach

Timely and Accurate Detection of Model Deviation in Self-Adaptive Software-Intensive Systems

SIT: Sampling-based Interactive Testing for Self-Adaptive Apps

Research on Intelligent Control System of Environmental Control Test based on Model System Engineering

An Approach Based on Situation Analysis and Separation of Environment Perception to Implement Adaptive Strategies

Towards a General Supporting Framework for Self-Adaptive Software Systems.

Verifying Stochastic Behaviors of Decentralized Self-Adaptive Systems: A Formal Modeling and Simulation Based Approach

Deep Reinforcement Learning for Adverse Garage Scenario Generation

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing