Abstract:Faced with the challenges of security strategy design brought about by the complexity of attack behavior and the dynamism of network structure, dynamic hierarchical intelligent defense methods have shown their effectiveness. However, in complex network environments, their application requires a higher level of coordination mechanisms. Therefore, this paper proposes a hierarchical multi-agent reinforcement learning network attack and defense game and cooperative defense decision-making method, which autonomously and efficiently completes the formulation of defense strategies and defense behavior responses. Firstly, we construct a Stackelberg hypergame model of cyberspace conflicts, and under the condition of information loss, characterize the multi-layer dynamic defense coordination response mechanism. Secondly, By utilizing a hierarchical multi-agent reinforcement learning method as the driving force for game evolution, we sequentially solve the Nash equilibrium of the game, and form a dynamic autonomous defense strategy. Finally, we construct a hierarchical multi-agent reinforcement learning framework, which decouples the defense decision problem, reduces the dimension of the defense action space and the exploration difficulty of the strategy space, and learns coordinated defense strategies more efficiently. We used the CybORG (Cyber Operations Research Gym) environment for simulation. We compared and analyzed the autonomously generated cyber defense strategies with other related works, verifying the superior coordination performance of our method in defense strategy generation and control.

SAND: Semi-Automated Adaptive Network Defense Via Programmable Rule Generation and Deployment

Evolving Defense Mechanism for Future Network Security

Guarding the Perimeter of Cloud-Based Enterprise Networks: an Intelligent SDN Firewall

Proactive Security Defense of Dynamic Network

Markov Decision Process For Automatic Cyber Defense

SDN-Empowered Reliable and Dynamic Scheduling Scheme for Security Resources.

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning

Network Attack-Defense Simulation Training System Based on HLA

SDN-Defend: A Lightweight Online Attack Detection and Mitigation System for DDoS Attacks in SDN

SDNKeeper: Lightweight Resource Protection and Management System for SDN-based Cloud

SDN Oriented Software-Defined Security Architecture

An Intelligent Honeynet Architecture Based on Software Defined Security.

REAL-GUARD

Adaptive Suspicious Prevention for Defending DoS Attacks in SDN-Based Convergent Networks

Dynamic Construction Scheme for Virtualization Security Service in Software-Defined Networks

Demo: the Design and Implementation of Intelligent Software Defined Security Framework

The Path To Autonomous Cyber Defense

An adaptive multistage intrusion detection and prevention system in software defined networking environment

SDM-based electronic defense intelligent networking technology

Network defense decision-making based on deep reinforcement learning and dynamic game theory

DDoS Defense Method in Software-Defined Space-Air-Ground Network from Dynamic Bayesian Game Perspective