Abstract:In numerous artificial intelligence applications, the collaborative efforts of multiple intelligent agents are imperative for the successful attainment of target objectives. To enhance coordination among these agents, a distributed communication framework is often employed. However, indiscriminate information sharing among all agents can be resource-intensive, and the adoption of manually pre-defined communication architectures imposes constraints on inter-agent communication, thus limiting the potential for effective collaboration. Moreover, the communication framework often remains static during inference, which may result in sustained high resource consumption, as in most cases, only key decisions necessitate information sharing among agents. In this study, we introduce a novel approach wherein we conceptualize the communication architecture among agents as a learnable graph. We formulate this problem as the task of determining the communication graph while enabling the architecture parameters to update normally, thus necessitating a bi-level optimization process. Utilizing continuous relaxation of the graph representation and incorporating attention units, our proposed approach, CommFormer, efficiently optimizes the communication graph and concurrently refines architectural parameters through gradient descent in an end-to-end manner. Additionally, we introduce a temporal gating mechanism for each agent, enabling dynamic decisions on whether to receive shared information at a given time, based on current observations, thus improving decision-making efficiency. Extensive experiments on a variety of cooperative tasks substantiate the robustness of our model across diverse cooperative scenarios, where agents are able to develop more coordinated and sophisticated strategies regardless of changes in the number of agents.

Semantic Information Extraction and Multi-Agent Communication Optimization Based on Generative Pre-Trained Transformer

A Unified Multi-Task Semantic Communication System with Domain Adaptation

Agent-driven Generative Semantic Communication with Cross-Modality and Prediction

Learning Multi-Agent Communication from Graph Modeling Perspective

Communication Learning in Multi-Agent Systems from Graph Modeling Perspective

Rethinking Generative Semantic Communication for Multi-User Systems with Multi-Modal LLM

GraphComm: Efficient Graph Convolutional Communication for Multiagent Cooperation

Autonomous Agents in Software Development: A Vision Paper

Multi-Modal Fusion-Based Multi-Task Semantic Communication System

Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System

SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems

Semantic Communication with Adaptive Universal Transformer

Improving Multi-Agent Debate with Sparse Communication Topology

Adaptive In-conversation Team Building for Language Model Agents

Large Generative Model-assisted Talking-face Semantic Communication System

Neurosymbolic Transformers for Multi-Agent Communication

Enhancing Collaboration in Heterogeneous Multiagent Systems Through Communication Complementary Graph

Research on Multi-Agent Communication and Collaborative Decision-Making Based on Deep Reinforcement Learning

Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems

VisionCoder: Empowering Multi-Agent Auto-Programming for Image Processing with Hybrid LLMs

A Unified Multi-Task Semantic Communication System for Multimodal Data