Abstract:Cell-free massive multiple-input multiple-output (mMIMO) offers significant advantages in mobility scenarios, mainly due to the elimination of cell boundaries and strong macro diversity. In this paper, we examine the downlink performance of cell-free mMIMO systems equipped with mobile-APs utilizing the concept of unmanned aerial vehicles, where mobility and power control are jointly considered to effectively enhance coverage and suppress interference. However, the high computational complexity, poor collaboration, limited scalability, and uneven reward distribution of conventional optimization schemes lead to serious performance degradation and instability. These factors complicate the provision of consistent and high-quality service across all user equipments in downlink cell-free mMIMO systems. Consequently, we propose a novel scalable framework enhanced by multi-agent reinforcement learning (MARL) to tackle these challenges. The established framework incorporates a graph neural network (GNN)-aided communication mechanism to facilitate effective collaboration among agents, a permutation architecture to improve scalability, and a directional decoupling architecture to accurately distinguish contributions. In the numerical results, we present comparisons of different optimization schemes and network architectures, which reveal that the proposed scheme can effectively enhance system performance compared to conventional schemes due to the adoption of advanced technologies. In particular, appropriately compressing the observation space of agents is beneficial for achieving a better balance between performance and convergence.

Cell-Free XL-MIMO Meets Multi-Agent Reinforcement Learning: Architectures, Challenges, and Future Directions

Mobile Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning: A Scalable Framework

Double-Layer Power Control for Mobile Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

Extremely Large-Scale MIMO: Fundamentals, Challenges, Solutions, and Future Directions

Learning-Based Intelligent Reflecting Surface-Aided Cell-Free Massive MIMO Systems

Distributed Collaborative User Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning

Uplink Power Control for Extremely Large-Scale MIMO with Multi-Agent Reinforcement Learning and Fuzzy Logic

Mobile Cell-Free Massive MIMO: Challenges, Solutions, and Future Directions

A Tutorial on Extremely Large-Scale MIMO for 6G: Fundamentals, Signal Processing, and Applications

Distributed Beam Selection for Millimeter-Wave Cell-Free Massive MIMO Based on Multi-Agent Deep Reinforcement Learning

Cell-free ISAC Massive MIMO Systems with Capacity-Constrained Fronthaul Links

Multi-agent Reinforcement Learning-based User Scheduling and Resource Allocation in Cell-free Networks.

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Next Generation Multiple Access with Cell-Free Massive MIMO

Cooperative Multi-Target Positioning for Cell-Free Massive MIMO with Multi-Agent Reinforcement Learning

A Novel Model-Assisted Decentralized Multi-Agent Reinforcement Learning for Joint Optimization of Hybrid Beamforming in Massive MIMO mmWave Systems

Multi-Agent Reinforcement Learning for Multi-Cell Spectrum and Power Allocation

Multi-Agent Deep Reinforcement Learning for Massive Access in 5G and Beyond Ultra-Dense NOMA System

Distributed Coordinated Beamforming Based on Multi-Agent Reinforcement Learning in Multicell MISO Systems