Abstract:Faced with the challenges of security strategy design brought about by the complexity of attack behavior and the dynamism of network structure, dynamic hierarchical intelligent defense methods have shown their effectiveness. However, in complex network environments, their application requires a higher level of coordination mechanisms. Therefore, this paper proposes a hierarchical multi-agent reinforcement learning network attack and defense game and cooperative defense decision-making method, which autonomously and efficiently completes the formulation of defense strategies and defense behavior responses. Firstly, we construct a Stackelberg hypergame model of cyberspace conflicts, and under the condition of information loss, characterize the multi-layer dynamic defense coordination response mechanism. Secondly, By utilizing a hierarchical multi-agent reinforcement learning method as the driving force for game evolution, we sequentially solve the Nash equilibrium of the game, and form a dynamic autonomous defense strategy. Finally, we construct a hierarchical multi-agent reinforcement learning framework, which decouples the defense decision problem, reduces the dimension of the defense action space and the exploration difficulty of the strategy space, and learns coordinated defense strategies more efficiently. We used the CybORG (Cyber Operations Research Gym) environment for simulation. We compared and analyzed the autonomously generated cyber defense strategies with other related works, verifying the superior coordination performance of our method in defense strategy generation and control.

Research on Network Security Collaborative Early-Warning Based on Multi-agent

Research on Network Management Systems Via Multi-Agent Technology

Multi-agent based coordination of public detection resources

Networked Supervisory Control System Based On Multi-Agent

Redundancy-Reduction-Based Hierarchical Design in Synchronization of Multi-Agent Systems

An Agent-Oriented Network Worm Defense System based on Optimized Path

Research of United Platform of Network Security Management Model

QoS-based Adaptive Access Control in Collaborative Virtual Enviroment

Research into Agent-oriented Worm Defense System

Study on adaptive trust alert correlation P2P overlay IDS

An Overlay Network Based Collaborative Network Security System

A Collaborative Network Security Management System in Metropolitan Area Network

NetSecu: A Collaborative Network Security Platform for In-network Security

A Blackboard Sharing Mechanism for Community Cyber Threat Intelligence Based on Multi-Agent System.

Collaborative Intrusion Detection Scheme for Network-Attached Storage Based on Agents

Study of Network Security Monitor System Based on Intelligent Agents

A novel collaboration and communication decision based on multi-agent in wireless sensor network

CloudSEC: A Cloud Architecture for Composing Collaborative Security Services

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning

A Multi-Agent Based Wide-Area Protection Scheme for Distributed Cyber Energy System

Research and Design on Early Warning System of Dangerous Sources Based on GIS and Multi Agent