Abstract:Decentralized and lifelong-adaptive multi-agent collaborative learning aims to enhance collaboration among multiple agents without a central server, with each agent solving varied tasks over time. To achieve efficient collaboration, agents should: i) autonomously identify beneficial collaborative relationships in a decentralized manner; and ii) adapt to dynamically changing task observations. In this paper, we propose DeLAMA, a decentralized multi-agent lifelong collaborative learning algorithm with dynamic collaboration graphs. To promote autonomous collaboration relationship learning, we propose a decentralized graph structure learning algorithm, eliminating the need for external priors. To facilitate adaptation to dynamic tasks, we design a memory unit to capture the agents' accumulated learning history and knowledge, while preserving finite storage consumption. To further augment the system's expressive capabilities and computational efficiency, we apply algorithm unrolling, leveraging the advantages of both mathematical optimization and neural networks. This allows the agents to `learn to collaborate' through the supervision of training tasks. Our theoretical analysis verifies that inter-agent collaboration is communication efficient under a small number of communication rounds. The experimental results verify its ability to facilitate the discovery of collaboration strategies and adaptation to dynamic learning scenarios, achieving a 98.80% reduction in MSE and a 188.87% improvement in classification accuracy. We expect our work can serve as a foundational technique to facilitate future works towards an intelligent, decentralized, and dynamic multi-agent system. Code is available at https://github.com/ShuoTang123/DeLAMA.

Effective approaches to Adaptive Collaboration.

Effective Approaches to Adaptive Collaboration Via Dynamic Role Assignment

AdaSharing: Adaptive Data Sharing in Collaborative Robots

Examining the Effect of a Genetic Algorithm-Enabled Grouping Method on Collaborative Performances, Processes, and Perceptions

An Implementation for Collaborative Manufacturing Platform Oriented to Distributed Environment

Multi-Agent Based Architecture Supporting Collaborative Product Lightweight Design

An Artificial Intelligence driven Learning Analytics Method to Examine the Collaborative Problem solving Process from a Complex Adaptive Systems Perspective

Adaptive In-conversation Team Building for Language Model Agents

Effective approaches to group role assignment with a flexible formation

Combinatorial-hybrid Optimization for Multi-agent Systems under Collaborative Tasks

Adaptive Data Sharing and Computation Offloading in Cloud-Edge Computing with Resource Constraints.

Collaboration Space Division in Collaborative Product Development Based on a Genetic Algorithm

Research on group awareness of networked collaboration within the design team and between teams

Graph Enhanced Reinforcement Learning for Effective Group Formation in Collaborative Problem Solving

Enhancing Investment Analysis: Optimizing AI-Agent Collaboration in Financial Research

A Multi-Agent Based Collaborative Design System

Coordinating Multi-Agent Reinforcement Learning Via Dual Collaborative Constraints

Adjusting Organization to Improve Coordination for Large Heterogeneous Multi-agent Teams.

Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning

A Large-Scale Global Optimization Algorithm with a New Adaptive Computing Resource Allocation Mechanism

Frontiers of Collaborative Intelligence Systems