Abstract:Secure and robust deep reinforcement learning (DRL) is necessary to deploy DRL algorithms in real world applications. However, previous work shows that DRL policies are vulnerable to adversarial attacks. In order to study the vulnerability/robustness of DRL algorithms, previous work has explored various attacks against DRL policies assuming that the attacker has access to the original policy either in a white-box manner or black-box manner. However, the realizability of these attacks is limited as assuming access to the original training environment or the policy could sometimes be impossible. In this study, we propose a set of novel adversarial attack approaches against DRL policies based on domain randomization, and we do not have the assumption of access to the exact original training environment nor the original policy, nor the possibility of querying the exact original policy. We first systematically analyze the space of transferable adversarial attacks against DRL when the attacker has almost no knowledge about the original training environment information such as system dynamics, action space, reward function, and/or information about the trained policy such as the algorithms and network structure. Then we train an attacker on multiple different environments with different dynamics, action space and reward settings, and also with different RL algorithms. We separately evaluate the effectiveness of the proposed attack when the environment changes or the algorithm used to train the pristine model changes. We compare our method with traditional adversarial attacks to show the improved transferability.

Domain Adaptation for Reinforcement Learning on the Atari

Transfer Learning and Deep Domain Adaptation

Domain Adaptation In Reinforcement Learning Via Latent Unified State Representation

Domain Adaptation Through Task Distillation

Domain Adaptive State Representation Alignment for Reinforcement Learning

Domain Adversarial Reinforcement Learning for Partial Domain Adaptation

Cross-Domain Communications Between Agents Via Adversarial-Based Domain Adaptation in Reinforcement Learning

Task and Domain Adaptive Reinforcement Learning for Robot Control

Cross-Modal Domain Adaptation for Reinforcement Learning

Domain-Adversarial Training of Neural Networks

Transferring Domain Knowledge with an Adviser in Continuous Tasks

Attend, Adapt and Transfer: Attentive Deep Architecture for Adaptive Transfer from multiple sources in the same domain

Transferable Adversarial Attacks on Deep Reinforcement Learning with Domain Randomization

Transferable Adversarial Training: A General Approach to Adapting Deep Classifiers

Skill based transfer learning with domain adaptation for continuous reinforcement learning domains

Unsupervised Domain Adaptation: from Simulation Engine to the RealWorld

Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning

Domain Adaptation of Visual Policies with a Single Demonstration

Cross-Domain Policy Transfer by Representation Alignment via Multi-Domain Behavioral Cloning

Learning Representative Trajectories of Dynamical Systems via Domain-Adaptive Imitation

ADAPTER-RL: Adaptation of Any Agent using Reinforcement Learning