Oriol Vinyals,Igor Babuschkin,Wojciech M. Czarnecki,Michaël Mathieu,Andrew Dudzik,Junyoung Chung,David H. Choi,Richard Powell,Timo Ewalds,Petko Georgiev,Junhyuk Oh,Dan Horgan,Manuel Kroiss,Ivo Danihelka,Aja Huang,Laurent Sifre,Trevor Cai,John P. Agapiou,Max Jaderberg,Alexander S. Vezhnevets,Rémi Leblond,Tobias Pohlen,Valentin Dalibard,David Budden,Yury Sulsky,James Molloy,Tom L. Paine,Caglar Gulcehre,Ziyu Wang,Tobias Pfaff,Yuhuai Wu,Roman Ring,Dani Yogatama,Dario Wünsch,Katrina McKinney,Oliver Smith,Tom Schaul,Timothy Lillicrap,Koray Kavukcuoglu,Demis Hassabis,Chris Apps,David Silver

Abstract:Many real-world applications require artificial agents to compete and coordinate with other agents in complex environments. As a stepping stone to this goal, the domain of StarCraft has emerged as an important challenge for artificial intelligence research, owing to its iconic and enduring status among the most difficult professional esports and its relevance to the real world in terms of its raw complexity and multi-agent challenges. Over the course of a decade and numerous competitions<a href="#ref-CR1">1</a>,<a href="#ref-CR2">2</a>,<a href="/articles/s41586-019-1724-z#ref-CR3">3</a>, the strongest agents have simplified important aspects of the game, utilized superhuman capabilities, or employed hand-crafted sub-systems<a href="/articles/s41586-019-1724-z#ref-CR4">4</a>. Despite these advantages, no previous agent has come close to matching the overall skill of top StarCraft players. We chose to address the challenge of StarCraft using general-purpose learning methods that are in principle applicable to other complex domains: a multi-agent reinforcement learning algorithm that uses data from both human and agent games within a diverse league of continually adapting strategies and counter-strategies, each represented by deep neural networks<a href="/articles/s41586-019-1724-z#ref-CR5">5</a>,<a href="/articles/s41586-019-1724-z#ref-CR6">6</a>. We evaluated our agent, AlphaStar, in the full game of StarCraft II, through a series of online games against human players. AlphaStar was rated at Grandmaster level for all three StarCraft races and above 99.8% of officially ranked human players.

Supervised Learning Achieves Human-Level Performance in MOBA Games: A Case Study of Honor of Kings

Towards Playing Full MOBA Games with Deep Reinforcement Learning

Mastering Complex Control in MOBA Games with Deep Reinforcement Learning

Suphx: Mastering mahjong with deep reinforcement learning

Hierarchical Reinforcement Learning for Multi-agent MOBA Game

Hierarchical Macro Strategy Model for MOBA Game AI

Deep learning in multiplayer online battle arena games

SCC: an efficient deep reinforcement learning agent mastering the game of StarCraft II

Building a 3-Player Mahjong AI using Deep Reinforcement Learning

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment

Towards a Competitive 3-Player Mahjong AI Using Deep Reinforcement Learning

Towards Effective and Interpretable Human-Agent Collaboration in MOBA Games: A Communication Perspective

Uprising E-sports Industry: machine learning/AI improve in-game performance using deep reinforcement learning

Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain

Evaluation of Human-AI Teams for Learned and Rule-Based Agents in Hanabi

Learning Diverse Policies in MOBA Games via Macro-Goals

Mastering Strategy Card Game (Hearthstone) with Improved Techniques

Grandmaster level in StarCraft II using multi-agent reinforcement learning