Abstract:Coordination among multiple autonomous, distributed cognitive agents is one of the most challenging and ubiquitous problems in Distributed AI and its applications in general, and in collaborative multi-agent systems in particular. A particularly prominent problem in multi-agent coordination is that of group, team or coalition formation. A considerable majority of the approaches to this problem found in the literature assume fixed interactions among autonomous agents involved in the coalition formation process. Moreover, most of the prior research where agents are actually able to learn and adapt based on their past interactions mainly focuses on reinforcement learning techniques at the individual agent level. We argue that, in many important applications and contexts, complex large-scale collaborative multi-agent systems need to be able to learn and adapt at multiple organization, hierarchical and logical levels. In particular, the agents need to be able to learn both at the level of individual agents and at the system or agent ensemble levels, and then to integrate these different sources of learned knowledge and behavior, in order to be effective at solving complex tasks in typical dynamic, partially observable and noisy multi-agent environments. In this paper, we describe a conceptual framework for addressing the problem of learning how to coordinate effectively at three qualitatively distinct levels — those of (i) individual agents, (ii) small groups of agents, and (iii) very large agent ensembles (or alternatively, depending on the nature of a multi-agent system, at the system or central control level). We briefly illustrate the applicability and usefulness of the proposed conceptual framework with an example of how it would apply to an important practical coordination problem, namely that of distributed coordination of a large ensemble of unmanned vehicles on a complex multi-task mission.

Coordination Scheme Probing for Generalizable Multi-Agent Reinforcement Learning

Learning to Coordinate with Anyone

Coordination as inference in multi-agent reinforcement learning

Learning Generalizable Risk-Sensitive Policies to Coordinate in Decentralized Multi-Agent General-Sum Games

Multiagent Q-learning with Sub-Team Coordination.

Coordinating Multi-Agent Reinforcement Learning Via Dual Collaborative Constraints

Improving Zero-Shot Coordination Performance Based on Policy Similarity

Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition

Enhancing Multi-Agent Coordination through Common Operating Picture Integration

Heterogeneous Multi-agent Zero-Shot Coordination by Coevolution

Multi-agent Continual Coordination Via Progressive Task Contextualization

KnowPC: Knowledge-Driven Programmatic Reinforcement Learning for Zero-shot Coordination

Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In the Game of Hanabi

Skill Discovery of Coordination in Multi-agent Reinforcement Learning

ProAgent: Building Proactive Cooperative Agents with Large Language Models

A unified framework for reinforcement learning, co-learning and meta-learning how to coordinate in collaborative multi-agent systems

Inferring Latent Temporal Sparse Coordination Graph for Multi-Agent Reinforcement Learning

Multi-Robot Environmental Coverage With a Two-Stage Coordination Strategy via Deep Reinforcement Learning

Coordinated Exploration via Intrinsic Rewards for Multi-Agent Reinforcement Learning

Multiagent Continual Coordination via Progressive Task Contextualization

Self-Motivated Multi-Agent Exploration