Abstract:Green Security Games (GSGs) have been successfully used in the protection of valuable resources such as fisheries, forests and wildlife. While real-world deployment involves both resource allocation and subsequent coordinated patrolling with communication and real-time, uncertain information, previous game models do not fully address both of these stages simultaneously. Furthermore, adopting existing solution strategies is difficult since they do not scale well for larger, more complex variants of the game models. We therefore first propose a novel GSG model that combines defender allocation, patrolling, real-time drone notification to human patrollers, and drones sending warning signals to attackers. The model further incorporates uncertainty for real-time decision-making within a team of drones and human patrollers. Second, we present CombSGPO, a novel and scalable algorithm based on reinforcement learning, to compute a defender strategy for this game model. CombSGPO performs policy search over a multi-dimensional, discrete action space to compute an allocation strategy that is best suited to a best-response patrolling strategy for the defender, learnt by training a multi-agent Deep Q-Network. We show via experiments that CombSGPO converges to better strategies and is more scalable than comparable approaches. Third, we provide a detailed analysis of the coordination and signaling behavior learnt by CombSGPO, showing group formation between defender resources and patrolling formations based on signaling and notifications between resources. Importantly, we find that strategic signaling emerges in the final learnt strategy. Finally, we perform experiments to evaluate these strategies under different levels of uncertainty.

Deep Reinforcement Learning for Green Security Game with Online Information.

Deep Reinforcement Learning for Green Security Games with Real-Time Information

Large Scale Pursuit-Evasion under Collision Avoidance Using Deep Reinforcement Learning.

Reinforcement Learning for Unified Allocation and Patrolling in Signaling Games with Uncertainty

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

TSGS: Two-stage security game solution based on deep reinforcement learning for Internet of Things

Green Security Game with Community Engagement

An Improved Approach Towards Multi-Agent Pursuit–Evasion Game Decision-Making Using Deep Reinforcement Learning

Security Defense Strategy Algorithm for Internet of Things Based on Deep Reinforcement Learning

Evolutionary Approach to Security Games with Signaling

Intrusion Detection in Green Internet of Things: A Deep Deterministic Policy Gradient-Based Algorithm.

Dueling Network Architecture for Multi-Agent Deep Deterministic Policy Gradient

A Deep Reinforcement Learning-Based Method Applied for Solving Multi-Agent Defense and Attack Problems.

Finding Effective Security Strategies through Reinforcement Learning and Self-Play

Collaborative Optimization of Game Enemy Design and Network Security Defense Based on Deep Reinforcement Learning

Dual-Mandate Patrols: Multi-Armed Bandits for Green Security

Network Security Defense Strategy of Deep Reinforcement Learning Oriented to Game Battle

A Deep Reinforcement Learning Method for Lion and Man Problem

Defending Smart Electrical Power Grids Against Cyberattacks with Deep Q -Learning

Research on Game-Playing Agents Based on Deep Reinforcement Learning.

A method of network attack-defense game and collaborative defense decision-making based on hierarchical multi-agent reinforcement learning