Abstract:Learning agents that are not only capable of taking tests, but also innovating is becoming a hot topic in AI. One of the most promising paths towards this vision is multi-agent learning, where agents act as the environment for each other, and improving each agent means proposing new problems for others. However, existing evaluation platforms are either not compatible with multi-agent settings, or limited to a specific game. That is, there is not yet a general evaluation platform for research on multi-agent intelligence. To this end, we introduce Arena, a general evaluation platform for multi-agent intelligence with 35 games of diverse logics and representations. Furthermore, multi-agent intelligence is still at the stage where many problems remain unexplored. Therefore, we provide a building toolkit for researchers to easily invent and build novel multi-agent problems from the provided game set based on a GUI-configurable social tree and five basic multi-agent reward schemes. Finally, we provide Python implementations of five state-of-the-art deep multi-agent reinforcement learning baselines. Along with the baseline implementations, we release a set of 100 best agents/teams that we can train with different training schemes for each game, as the base for evaluating agents with population performance. As such, the research community can perform comparisons under a stable and uniform standard. All the implementations and accompanied tutorials have been open-sourced for the community at https://sites.google.com/view/arena-unity/.

Multiplayer Support for the Arcade Learning Environment

The Arcade Learning Environment: An Evaluation Platform for General Agents

Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents

CALE: Continuous Arcade Learning Environment

PettingZoo: Gym for Multi-Agent Reinforcement Learning

Playing SNES in the Retro Learning Environment

State of the art control of atari games using shallow reinforcement learning

Mastering Asymmetrical Multiplayer Game with Multi-Agent Asymmetric-Evolution Reinforcement Learning

A Comparison of learning algorithms on the Arcade Learning Environment

Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence

Arena: a toolkit for Multi-Agent Reinforcement Learning

SOCIALGYM 2.0: Simulator for Multi-Agent Social Robot Navigation in Shared Human Spaces

PyTAG: Tabletop Games for Multi-Agent Reinforcement Learning

Learning Environment for the Air Domain (LEAD)

Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment

Aquarium: A Comprehensive Framework for Exploring Predator-Prey Dynamics through Multi-Agent Reinforcement Learning Algorithms

Evolution with Opponent-Learning Awareness

TLeague: A Framework for Competitive Self-Play based Distributed Multi-Agent Reinforcement Learning

A Generalized Training Approach for Multiagent Learning

ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency