Abstract:Complex systems, characterized by intricate interactions among numerous entities, give rise to emergent behaviors whose data-driven modeling and control are of utmost significance, especially when there is abundant observational data but the intervention cost is high. Traditional methods rely on precise dynamical models or require extensive intervention data, often falling short in real-world applications. To bridge this gap, we consider a specific setting of the complex systems control problem: how to control complex systems through a few online interactions on some intervenable nodes when abundant observational data from natural evolution is available. We introduce a two-stage model predictive complex system control framework, comprising an offline pre-training phase that leverages rich observational data to capture spontaneous evolutionary dynamics and an online fine-tuning phase that uses a variant of model predictive control to implement intervention actions. To address the high-dimensional nature of the state-action space in complex systems, we propose a novel approach employing action-extended graph neural networks to model the Markov decision process of complex systems and design a hierarchical action space for learning intervention actions. This approach performs well in three complex system control environments: Boids, Kuramoto, and Susceptible-Infectious-Susceptible (SIS) metapopulation. It offers accelerated convergence, robust generalization, and reduced intervention costs compared to the baseline algorithm. This work provides valuable insights into controlling complex systems with high-dimensional state-action spaces and limited intervention data, presenting promising applications for real-world challenges.

A New Complex Incident Response Plan Decision-Making Model

Multi-agent based hybrid Intrusion detection system

Think That Attackers Think: Using First-Order Theory of Mind in Intrusion Response System.

Modeling and Analysis of the Decentralized Interactive Cyber Defense Approach

A Hierarchical and Factored POMDP Based Automated Intrusion Response Framework

Decision model of intrusion response based on markov game in fog computing environment

Research for Emergency Exercise Network System Based on Scenario Analysis

Modeling and Control Architecture for the Competitive Networked Robot System Based on POMDP

Design and Analysis of Decentralized Interactive Cyber Defense Approach based on Multi-agent Coordination.

ICONE23-1434 A NEW DECISION SUPPORT SYSTEM FOR NUCLEAR EMERGENCY RESPONSE BASED ON EMERGENCY PLANS

NAIR: A Novel Automated Intrusion Response System Based on Decision Making Approach

Network Security Defense Decision-Making Method Based on Stochastic Game and Deep Reinforcement Learning

Network defense decision-making based on deep reinforcement learning and dynamic game theory

A Network Attack Plan Recognition Algorithm Based on the Extended Goal Graph

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning

Fortified Network Security Perception: A Decentralized Multiagent Coordination Perspective

A Preliminary Research on Incident Chain Modeling and Analysis

A goal-oriented emergency countermeasure planning method using graph-based path search and functional reasoning

Decision-making Model of Tactics Maneuver Agent Based on Fuzzy Markov Decision Theory

Combining Building and Behavior Models for Evacuation Planning

Model predictive complex system control from observational and interventional data