Abstract:Faced with the challenges of security strategy design brought about by the complexity of attack behavior and the dynamism of network structure, dynamic hierarchical intelligent defense methods have shown their effectiveness. However, in complex network environments, their application requires a higher level of coordination mechanisms. Therefore, this paper proposes a hierarchical multi-agent reinforcement learning network attack and defense game and cooperative defense decision-making method, which autonomously and efficiently completes the formulation of defense strategies and defense behavior responses. Firstly, we construct a Stackelberg hypergame model of cyberspace conflicts, and under the condition of information loss, characterize the multi-layer dynamic defense coordination response mechanism. Secondly, By utilizing a hierarchical multi-agent reinforcement learning method as the driving force for game evolution, we sequentially solve the Nash equilibrium of the game, and form a dynamic autonomous defense strategy. Finally, we construct a hierarchical multi-agent reinforcement learning framework, which decouples the defense decision problem, reduces the dimension of the defense action space and the exploration difficulty of the strategy space, and learns coordinated defense strategies more efficiently. We used the CybORG (Cyber Operations Research Gym) environment for simulation. We compared and analyzed the autonomously generated cyber defense strategies with other related works, verifying the superior coordination performance of our method in defense strategy generation and control.

Network Attack-Defense Simulation Training System Based on HLA

Research on the Design of Attack-recovery Battlefield Simulation System Based on HLA

Research of Conceptual Model Based on Attack and Defense System Design

Research and Implementation of Network Security Cooperative Defense System

Research on the simulation platform of surface ship torpedo defence system based on HLA

Modeling and Simulation of Command and Control System Based on HLA Technology in the Cooperative Air Combat

Design of Simulation System about Aviation Weapon Cooperative Engagement Based on HLA

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning

An Airborne Laser (ABL) Weapon Simulation System Based on HLA

Research on Tactical Task Simulation System Based on HLA

Application of Virtual Machine in Warship Formation Defense System

Surface-to-air Missile Simulation System Design Based on HLA

Research of Electronic Countermeasure Simulation System Framework Based on HLA

Distributed Aviation Communication Network Simulation Platform Based on HLA

Network Security Modeling and Cyber Attack Simulation Methodology

Design and Implementation of Training Simulation System for Surface-to-Air Missile

On HLA-based Fire Command Training Simulation System

Research of Electronic Countermeasures Training Simulation System Based on HLA

Distributed virtual training: New training mode for complex weapon system

Agent-based simulation and analysis of networking air defense missile systems

Research on Anti-reconnaissance Simulation System of Fire-control Radar Network Based on HLA