Abstract:In numerous artificial intelligence applications, the collaborative efforts of multiple intelligent agents are imperative for the successful attainment of target objectives. To enhance coordination among these agents, a distributed communication framework is often employed. However, indiscriminate information sharing among all agents can be resource-intensive, and the adoption of manually pre-defined communication architectures imposes constraints on inter-agent communication, thus limiting the potential for effective collaboration. Moreover, the communication framework often remains static during inference, which may result in sustained high resource consumption, as in most cases, only key decisions necessitate information sharing among agents. In this study, we introduce a novel approach wherein we conceptualize the communication architecture among agents as a learnable graph. We formulate this problem as the task of determining the communication graph while enabling the architecture parameters to update normally, thus necessitating a bi-level optimization process. Utilizing continuous relaxation of the graph representation and incorporating attention units, our proposed approach, CommFormer, efficiently optimizes the communication graph and concurrently refines architectural parameters through gradient descent in an end-to-end manner. Additionally, we introduce a temporal gating mechanism for each agent, enabling dynamic decisions on whether to receive shared information at a given time, based on current observations, thus improving decision-making efficiency. Extensive experiments on a variety of cooperative tasks substantiate the robustness of our model across diverse cooperative scenarios, where agents are able to develop more coordinated and sophisticated strategies regardless of changes in the number of agents.

Enhancing Agent Communication and Learning through Action and Language

Learning through Dialogue Interactions by Asking Questions

Dialogue Learning with Human-in-the-Loop.

CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society

Natural Language Communication with a Teachable Agent

Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning

Expressing social attitudes in virtual agents for social training games

Listen, Interact and Talk: Learning to Speak via Interaction

Mastering emergent language: learning to guide in simulated navigation

Using Conversational Agents To Support Learning By Teaching

Learning to Model the World with Language

Enhancement of Conversational Agents By Means of Multimodal Interaction

Learning to Infer Belief Embedded Communication

Overcoming Referential Ambiguity in Language-Guided Goal-Conditioned Reinforcement Learning

CGMI: Configurable General Multi-Agent Interaction Framework

Communication Learning in Multi-Agent Systems from Graph Modeling Perspective

Enhancing sentient embodied conversational agents with machine learning

Verco: Learning Coordinated Verbal Communication for Multi-agent Reinforcement Learning

Multi-Agent Language Learning: Symbolic Mapping

A Paradigm for Situated and Goal-Driven Language Learning

Towards Teachable Conversational Agents