Wireless Multi-Agent Generative AI: From Connected Intelligence to Collective Intelligence

Hang Zou,Qiyang Zhao,Lina Bariah,Mehdi Bennis,Merouane Debbah
2023-07-06
Abstract:The convergence of generative large language models (LLMs), edge networks, and multi-agent systems represents a groundbreaking synergy that holds immense promise for future wireless generations, harnessing the power of collective intelligence and paving the way for self-governed networks where intelligent decision-making happens right at the edge. This article puts the stepping-stone for incorporating multi-agent generative artificial intelligence (AI) in wireless networks, and sets the scene for realizing on-device LLMs, where multi-agent LLMs are collaboratively planning and solving tasks to achieve a number of network goals. We further investigate the profound limitations of cloud-based LLMs, and explore multi-agent LLMs from a game theoretic perspective, where agents collaboratively solve tasks in competitive environments. Moreover, we establish the underpinnings for the architecture design of wireless multi-agent generative AI systems at the network level and the agent level, and we identify the wireless technologies that are envisioned to play a key role in enabling on-device LLM. To demonstrate the promising potentials of wireless multi-agent generative AI networks, we highlight the benefits that can be achieved when implementing wireless generative agents in intent-based networking, and we provide a case study to showcase how on-device LLMs can contribute to solving network intents in a collaborative fashion. We finally shed lights on potential challenges and sketch a research roadmap towards realizing the vision of wireless collective intelligence.
Multiagent Systems
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to integrate generative multi - agent systems into wireless networks and achieve the transformation from connected intelligence to collective intelligence. Specifically, the paper focuses on how to implement large - language models (LLMs) on devices in wireless networks through multi - agent generative artificial intelligence (AI) techniques, enabling LLMs on multiple devices to collaboratively plan and solve problems in order to achieve network goals. This involves several key aspects: 1. **Limitations of Cloud - based LLMs**: The paper explores the profound limitations of cloud - based LLMs and proposes a new method, that is, through the application of multi - agent systems in wireless networks, to overcome these limitations. This method can not only reduce the dependence on cloud computing resources but also improve the response speed and decision - making efficiency of the system. 2. **Game - theoretical Perspective of Multi - agent LLMs**: The paper studies multi - agent LLMs from a game - theoretical perspective, in which agents can collaboratively solve problems in a competitive environment. This perspective helps to understand the interaction mechanisms between different agents and how to achieve common goals through cooperation. 3. **Architectural Design of Wireless Multi - agent Generative AI Systems**: The paper proposes the design basis of wireless multi - agent generative AI systems at the network level and the agent level, aiming to establish a framework that supports the collaboration of LLMs on devices. This includes defining how the system decomposes high - level goals into low - level tasks and how agents share knowledge through communication. 4. **Key Wireless Technologies for Implementing LLMs on Devices**: The paper also discusses which wireless technologies are expected to be the key technologies for implementing LLMs on devices, especially their roles in supporting multi - agent collaboration and knowledge transmission. In order to demonstrate the potential advantages of wireless multi - agent generative AI networks, the paper provides a case study, showing a scenario of ensuring the user transmission rate while achieving the network - level energy - consumption - reduction goal. In addition, the paper also points out the challenges faced in realizing the vision of wireless collective intelligence and outlines future research directions.