Abstract:Faced with the challenges of security strategy design brought about by the complexity of attack behavior and the dynamism of network structure, dynamic hierarchical intelligent defense methods have shown their effectiveness. However, in complex network environments, their application requires a higher level of coordination mechanisms. Therefore, this paper proposes a hierarchical multi-agent reinforcement learning network attack and defense game and cooperative defense decision-making method, which autonomously and efficiently completes the formulation of defense strategies and defense behavior responses. Firstly, we construct a Stackelberg hypergame model of cyberspace conflicts, and under the condition of information loss, characterize the multi-layer dynamic defense coordination response mechanism. Secondly, By utilizing a hierarchical multi-agent reinforcement learning method as the driving force for game evolution, we sequentially solve the Nash equilibrium of the game, and form a dynamic autonomous defense strategy. Finally, we construct a hierarchical multi-agent reinforcement learning framework, which decouples the defense decision problem, reduces the dimension of the defense action space and the exploration difficulty of the strategy space, and learns coordinated defense strategies more efficiently. We used the CybORG (Cyber Operations Research Gym) environment for simulation. We compared and analyzed the autonomously generated cyber defense strategies with other related works, verifying the superior coordination performance of our method in defense strategy generation and control.

Dynamic Game Model of Botnet DDoS Attack and Defense

Intelligent DDoS Detection in Botnet Combined with Packet-Level Features under SDN

Forensic Model for DDoS Attack

Modeling Social Engineering Botnet Dynamics Across Multiple Social Networks

Method Research for Defending Against Distributed Denial-of-Service Attacks Based on Dynamic Game Theory

Optimal Defense Strategies for DDoS Defender Using Bayesian Game Model

DDoS Defense Method in Software-Defined Space-Air-Ground Network from Dynamic Bayesian Game Perspective

Research and Implement of Large-scale Botnet abstract Model on PDNS

Defense of Advanced Persistent Threat on Industrial Internet of Things With Lateral Movement Modeling

An MTD-driven Hybrid Defense Method Against DDoS Based on Markov Game in Multi-controller SDN-enabled IoT Networks

Analyzing Miners' Dynamic Equilibrium in Blockchain Networks under DDoS Attacks

Game-theoretical Model for Dynamic Defense Resource Allocation in Cyber-physical Power Systems Under Distributed Denial of Service Attacks

Network Attack and Defense Modeling and System Security Analysis: A Novel Approach Using Stochastic Evolutionary Game Petri Net

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning

Integrated Cyber-Physical Resiliency for Power Grids under IoT-Enabled Dynamic Botnet Attacks

Research on Key Technologies and Defenses of Botnet

Enhancing cloud security: harnessing bayesian game theory for a dynamic defense mechanism

Proactive Defense Against Physical Denial of Service Attacks using Poisson Signaling Games

Attack–Defense Game Model with Multi-Type Attackers Considering Information Dilemma

Research on Botnet Mechanisms and Defenses

Game Strategies for Distributed Denial of Service Defense in the Cloud of Things