Abstract:Decentralized and lifelong-adaptive multi-agent collaborative learning aims to enhance collaboration among multiple agents without a central server, with each agent solving varied tasks over time. To achieve efficient collaboration, agents should: i) autonomously identify beneficial collaborative relationships in a decentralized manner; and ii) adapt to dynamically changing task observations. In this paper, we propose DeLAMA, a decentralized multi-agent lifelong collaborative learning algorithm with dynamic collaboration graphs. To promote autonomous collaboration relationship learning, we propose a decentralized graph structure learning algorithm, eliminating the need for external priors. To facilitate adaptation to dynamic tasks, we design a memory unit to capture the agents' accumulated learning history and knowledge, while preserving finite storage consumption. To further augment the system's expressive capabilities and computational efficiency, we apply algorithm unrolling, leveraging the advantages of both mathematical optimization and neural networks. This allows the agents to `learn to collaborate' through the supervision of training tasks. Our theoretical analysis verifies that inter-agent collaboration is communication efficient under a small number of communication rounds. The experimental results verify its ability to facilitate the discovery of collaboration strategies and adaptation to dynamic learning scenarios, achieving a 98.80% reduction in MSE and a 188.87% improvement in classification accuracy. We expect our work can serve as a foundational technique to facilitate future works towards an intelligent, decentralized, and dynamic multi-agent system. Code is available at https://github.com/ShuoTang123/DeLAMA.

Adaptive Data Collaboration Based on Multi-Agent Reinforcement Learning in Internet of Things

Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Intelligent Data Collaboration in Heterogeneous-device IoT Platforms

Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning

Collaborative Optimization of Wireless Communication and Computing Resource Allocation based on Multi-Agent Federated Weighting Deep Reinforcement Learning

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

FDC: A Secure Federated Deep Learning Mechanism for Data Collaborations in the Internet of Things

A Multi-Agents Deep Reinforcement Learning Autonomous Security Management Approach for Internet of Things

AC-DNN: An Adaptive Compact DNNs Architecture for Collaborative Learning Among Heterogeneous Smart Devices

Cloud-Edge-Client Collaborative Learning in Digital Twin Empowered Mobile Networks

Federated Dynamic Spectrum Access

Efficient Adaptive Federated Optimization of Federated Learning for IoT

Adaptive Training and Aggregation for Federated Learning in Multi-tier Computing Networks

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication

AdaptiveFL: Adaptive Heterogeneous Federated Learning for Resource-Constrained AIoT Systems

Cognitive Data Fusing for Internet of Things Based on Ensemble Learning and Federated Learning

Multiagent Reinforcement Learning Meets Random Access in Massive Cellular Internet of Things

Towards Energy-Aware Federated Learning via MARL: A Dual-Selection Approach for Model and Client

Semi-Federated Learning for Collaborative Intelligence in Massive IoT Networks

AFL: An Adaptively Federated Multi-Task Learning for Model Sharing in Industrial IoT

Federated Multi-Agent Actor-Critic Learning for Age Sensitive Mobile Edge Computing