Abstract:Cooperative Multi-Agent Reinforcement Learning (CMARL) strategies are well known to be vulnerable to adversarial perturbations. Previous works on adversarial attacks have primarily focused on white-box attacks that directly perturb the states or actions of victim agents, often in scenarios with a limited number of attacks. However, gaining complete access to victim agents in real-world environments is exceedingly difficult. To create more realistic adversarial attacks, we introduce a novel method that involves injecting traitor agents into the CMARL system. We model this problem as a Traitor Markov Decision Process (TMDP), where traitors cannot directly attack the victim agents but can influence their formation or positioning through collisions. In TMDP, traitors are trained using the same MARL algorithm as the victim agents, with their reward function set as the negative of the victim agents' reward. Despite this, the training efficiency for traitors remains low because it is challenging for them to directly associate their actions with the victim agents' rewards. To address this issue, we propose the Curiosity-Driven Adversarial Attack (CuDA2) framework. CuDA2 enhances the efficiency and aggressiveness of attacks on the specified victim agents' policies while maintaining the optimal policy invariance of the traitors. Specifically, we employ a pre-trained Random Network Distillation (RND) module, where the extra reward generated by the RND module encourages traitors to explore states unencountered by the victim agents. Extensive experiments on various scenarios from SMAC demonstrate that our CuDA2 framework offers comparable or superior adversarial attack capabilities compared to other baselines.

A Decentralized Multi-ruling Arbiter for Cyberspace Mimicry Defense

Confidence Skewing Problem and Its Correction Method in Mimic Arbitration Mechanism

Key-area Cyberspace Mimic Defense Against Data-Oriented Attacks

Resilient Consensus of Multi-Agent Systems Against Malicious Data Injections

Secure consensus for multiagent systems with hybrid cyber attacks: A multi-round robin protocol-based approach

Optimal Strategy for Cyberspace Mimic Defense Based on Game Theory

IDCAIS: Inter-Defender Collision-Aware Interception Strategy against Multiple Attackers

Distributed Adaptive Consensus Control for Nonlinear Systems with Active-Defense Mechanism Against Denial-of-Service Attacks

Privacy-Preserving Adaptive Resilient Consensus for Multi-Agent Systems under Cyber Attacks

CuDA2: An approach for Incorporating Traitor Agents into Cooperative Multi-Agent Systems

Mimic Defense: a Designed-in Cybersecurity Defense Framework.

Dual-domain Defenses for Byzantine-resilient Decentralized Resource Allocation

Anti-Attacking Modeling and Analysis of Cyberspace Mimic DNS

An Optimal Seed Scheduling Strategy Algorithm Applied to Cyberspace Mimic Defense

A defense strategy for false data injection attacks in multi-agent systems

A function-aware mimic defense theory and its practice

Distributed Model Predictive Consensus of MASs against False Data Injection Attacks and Denial-of-Service Attacks

CyberMoat: Camouflaging critical server infrastructures with large scale decoy farms.

Deception Maze: A Stackelberg Game-Theoretic Defense Mechanism for Intranet Threats

An Intensive Security Architecture With Multi-Controller For Sdn

Data-Driven Leader-following Consensus for Nonlinear Multi-Agent Systems against Composite Attacks: A Twins Layer Approach