Abstract:Researchers on artificial intelligence have achieved human-level intelligence in large-scale perfect-information games, but it is still a challenge to achieve (nearly) optimal results (in other words, an approximate Nash Equilibrium) in large-scale imperfect-information games (i.e. war games, football coach or business strategies). Neural Fictitious Self Play (NFSP) is an effective algorithm for learning approximate Nash equilibrium of imperfect-information games from self-play without prior domain knowledge. However, it relies on Deep Q-Network, which is off-line and is hard to converge in online games with changing opponent strategy, so it canu0027t approach approximate Nash equilibrium in games with large search scale and deep search depth. In this paper, we propose Monte Carlo Neural Fictitious Self Play (MC-NFSP), an algorithm combines Monte Carlo tree search with NFSP, which greatly improves the performance on large-scale zero-sum imperfect-information games. Experimentally, we demonstrate that the proposed Monte Carlo Neural Fictitious Self Play can converge to approximate Nash equilibrium in games with large-scale search depth while the Neural Fictitious Self Play canu0027t. Furthermore, we develop Asynchronous Neural Fictitious Self Play (ANFSP). It use asynchronous and parallel architecture to collect game experience. In experiments, we show that parallel actor-learners have a further accelerated and stabilizing effect on training.

Resilient Adaptively Distributed Nash Equilibrium Seeking Against Unknown False Data Injection Attacks in Noncooperative Games

Distributed Nash equilibrium searching for multi-agent games under false data injection attacks

Learning-Based Cooperative False Data Injection Attack and Its Mitigation Techniques in Consensus-Based Distributed Estimation

False Data Injection- and Propagation-Aware Game Theoretical Approach for Microgrids

Resilient algorithm for distributed resource allocation under false data injection attacks

Differential Game Approach for Modelling and Defense of False Data Injection Attacks Targeting Energy Metering Systems

Performance Analysis of Consensus-Based Distributed System Under False Data Injection Attacks.

Leader-Following Consensus Control of Unknown Nonlinear MASs Under False Data Injection Attacks

Adaptive approaches for fully distributed Nash equilibrium seeking in networked games

Monte Carlo Neural Fictitious Self-Play: Achieve Approximate Nash equilibrium of Imperfect-Information Games.

An Adaptive Generalized Nash Equilibrium Seeking Algorithm under High-Dimensional Input Dead-Zone

Fully Distributed Adaptive Nash Equilibrium Seeking Algorithm for Constrained Noncooperative Games with Prescribed Performance

Resilient Consensus Control for Linear Multi-agent System Against the False Data Injection Attacks

Distributed Nash equilibrium seeking strategies via bilateral bounded gradient approach

Fuzzy adaptive resilient decentralized control of nonlinear interconnected cyber-physical systems under false data injection attacks

Resilient Discrete‐Time Quantization Communication for Distributed Nash Equilibrium Seeking Under DoS Attacks

Submodularity-based False Data Injection Attack Scheme in Multi-agent Dynamical Systems

Distributed Nash Equilibrium Seeking for Aggregative Games With Nonlinear Dynamics Under External Disturbances

Distributed Nash Equilibrium Seeking for Games in Systems With Non-Symmetric Dead-Zone Inputs

Cooperative output regulation of heterogeneous multi‐agent systems under false data injection attacks

Event-Based Optimal Stealthy False Data-Injection Attacks Against Remote State Estimation Systems