Abstract:Multi-agent Reinforcement Learning (MARL) has gained wide attention in recent years and has made progress in various fields. Specifically, cooperative MARL focuses on training a team of agents to cooperatively achieve tasks that are difficult for a single agent to handle. It has shown great potential in applications such as path planning, autonomous driving, active voltage control, and dynamic algorithm configuration. One of the research focuses in the field of cooperative MARL is how to improve the coordination efficiency of the system, while research work has mainly been conducted in simple, static, and closed environment settings. To promote the application of artificial intelligence in real-world, some research has begun to explore multi-agent coordination in open environments. These works have made progress in exploring and researching the environments where important factors might change. However, the mainstream work still lacks a comprehensive review of the research direction. In this paper, starting from the concept of reinforcement learning, we subsequently introduce multi-agent systems (MAS), cooperative MARL, typical methods, and test environments. Then, we summarize the research work of cooperative MARL from closed to open environments, extract multiple research directions, and introduce typical works. Finally, we summarize the strengths and weaknesses of the current research, and look forward to the future development direction and research problems in cooperative MARL in open environments.

A Review of Multi-Agent Collaborative Control

A Review of Human-Machine Cooperation in the Robotics Domain

A Distributed Process Control System Based On Multi-Agent

A Survey on Intelligent Control for Multiagent Systems

An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination

On the Control of Multi-Agent Systems: A Survey

Cooperative control for heterogeneous multi-agent systems: progress, applications, and challenges

A Survey of An Intelligent Multi-Agent Formation Control

A Survey of Progress on Cooperative Multi-agent Reinforcement Learning in Open Environment

Self-attention-based multi-agent continuous control method in cooperative environments

Control of multi-agent systems: results, open problems, and applications

Survey of containment control in multi-agent systems: concepts, communication, dynamics, and controller design

A Review of Collaborative Air-Ground Robots Research

Event-Based Consensus Control of Multi-agent Systems

Survey of Multi-agent Communication Strategies for Information Exchange and Mission Control of Drone Deployments

Balancing Collective Exploration and Exploitation in Multi-Agent and Multi-Robot Systems: A Review

Fully Decentralized Cooperative Multi-Agent Reinforcement Learning: A Survey

Consensus of a new multi-agent system via multi-task, multi-control mechanism and multi-consensus strategy

Recent Advances in Consensus of Multi-Agent Systems: A Brief Survey

A Survey on Manipulator Control Using Multi-Agent Method

A survey on recent advances in distributed sampled-data cooperative control of multi-agent systems