Abstract:Deep Reinforcement Learning (DRL) algorithms have been increasingly employed during the last decade to solve various decision-making problems such as autonomous driving and robotics. However, these algorithms have faced great challenges when deployed in safety-critical environments since they often exhibit erroneous behaviors that can lead to potentially critical errors. One way to assess the safety of DRL agents is to test them to detect possible faults leading to critical failures during their execution. This raises the question of how we can efficiently test DRL policies to ensure their correctness and adherence to safety requirements. Most existing works on testing DRL agents use adversarial attacks that perturb states or actions of the agent. However, such attacks often lead to unrealistic states of the environment. Their main goal is to test the robustness of DRL agents rather than testing the compliance of agents' policies with respect to requirements. Due to the huge state space of DRL environments, the high cost of test execution, and the black-box nature of DRL algorithms, the exhaustive testing of DRL agents is impossible. In this paper, we propose a Search-based Testing Approach of Reinforcement Learning Agents (STARLA) to test the policy of a DRL agent by effectively searching for failing executions of the agent within a limited testing budget. We use machine learning models and a dedicated genetic algorithm to narrow the search towards faulty episodes. We apply STARLA on Deep-Q-Learning agents which are widely used as benchmarks and show that it significantly outperforms Random Testing by detecting more faults related to the agent's policy. We also investigate how to extract rules that characterize faulty episodes of the DRL agent using our search results. Such rules can be used to understand the conditions under which the agent fails and thus assess its deployment risks.

Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions

Model-based Test Generation for Robotic Software: Automata versus Belief-Desire-Intention Agents

Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions

Reinforcement Learning Informed Evolutionary Search for Autonomous Systems Testing

i-Sim2Real: Reinforcement Learning of Robotic Policies in Tight Human-Robot Interaction Loops

Bayesian Disturbance Injection: Robust Imitation Learning of Flexible Policies for Robot Manipulation

Reasoning-Based Software Testing

BDD-Based Framework with RL Integration: An approach for videogames automated testing

Automated Play-Testing Through RL Based Human-Like Play-Styles Generation

IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Reality

Robot Air Hockey: A Manipulation Testbed for Robot Learning with Reinforcement Learning

Design of BDI Agent for Adaptive Performance Testing of Web Services

Towards personalized human AI interaction - adapting the behavior of AI agents using neural signatures of subjective interest

Human‐Like Interactive Behavior Generation for Autonomous Vehicles: A Bayesian Game‐Theoretic Approach with Turing Test

A Search-Based Testing Approach for Deep Reinforcement Learning Agents

Reinforcement Learning for Safety Testing: Lessons from A Mobile Robot Case Study

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Integrating Human Expertise in Continuous Spaces: A Novel Interactive Bayesian Optimization Framework with Preference Expected Improvement

Testing of Deep Reinforcement Learning Agents with Surrogate Models

Test Agents: Adaptive, Autonomous and Intelligent Test Cases