Abstract:Numerous studies have demonstrated, in-depth, the vulnerability of the deep reinforcement learning (DRL) model’s elements (e.g., reward), which is a factor limiting the widespread deployment of DRL in some crucial domains, including intelligent traffic signal control (ITSC). While partial poisoning attacks with insidious rewards are enabled undetectable by directly employing regularization or cumulative reward restrictions, these constraints are somewhat one-dimensional and fail to consider the time dependence of DRL. Moreover, the adversary should avoid injecting undesirable perturbations when agents’ policies are unstable, namely effectively maximizing the attacking strategy’s benefit. It is thus a challenge to perturb the DRL model stealthily with as few disruption steps or modifications to the original sample as possible while ensuring the attack’s efficiency. In this work, two black-box reward space attack strategies are introduced, where we encourage the adversary to learn a malicious adversarial policy actively. The first is Multi Constraint Stealthy-time Attack which is updated with the penalties earned by attacking crucial moments, and restricted through action confidence and perturbations’ total number, to ensure attack times’ stealthiness. The second technique is Multi Objective Stealthy-modification Attack which is modeled as a multi-objective optimization problem, and the adversary balance attack performance and stealthy modification with weighting factor ω. Extensive simulation results evaluated in SUMO, involving comparison assessment and attack distribution, exhibit a dramatic increase in average travel time, implying that our attacks impose pressure on the traffic flow, namely the efficacy of proposed attack strategies.

Good Learning, Bad Performance: A Novel Attack Against RL-Based Congestion Control Systems

TRCC: Transferable Congestion Control with Reinforcement Learning

MARNet: Backdoor Attacks Against Cooperative Multi-Agent Reinforcement Learning

Exploring the Vulnerability of Deep Reinforcement Learning-based Emergency Control for Low Carbon Power Systems

RLCC: Practical Learning-based Congestion Control for the Internet

Promoting or Hindering: Stealthy Black-Box Attacks Against DRL-Based Traffic Signal Control

Reinforcement Learning Based Congestion Control in a Real Environment.

Stop-and-Go: Exploring Backdoor Attacks on Deep Reinforcement Learning-based Traffic Congestion Control Systems

Multi-Objective Network Congestion Control Via Constrained Reinforcement Learning.

Improving Robustness of Reinforcement Learning for Power System Control with Adversarial Training

Data-Based Collaborative Learning for Multiagent Systems under Distributed Denial-of-Service Attacks

Highly transferable adversarial attack against deep‐reinforcement‐learning‐based frequency control

Adversarial Attacks and Defense in Deep Reinforcement Learning (DRL)-Based Traffic Signal Controllers

Adversarial Attacks on Reinforcement Learning Agents for Command and Control

A Novel Distributed Reinforcement Learning Training System for Network Congestion Control

Coordinated Control of Urban Expressway Integrating Adjacent Signalized Intersections Using Adversarial Network Based Reinforcement Learning Method

A Novel Bifurcation Method for Observation Perturbation Attacks on Reinforcement Learning Agents: Load Altering Attacks on a Cyber Physical Power System

Internet Congestion Control via Deep Reinforcement Learning

Reinforcement Learning based Cyberattack Model for Adaptive Traffic Signal Controller in Connected Transportation Systems

A Distributed Reinforcement Learning Approach to In-network Congestion Control

Stealthy and efficient adversarial attacks against deep reinforcement learning