Abstract:Starting from the concept of the Cloud Radio Access Network (C-RAN), continuing with the virtual Radio Access Network (vRAN) and most recently with the Open RAN (O-RAN) initiative, Radio Access Network (RAN) architectures have significantly evolved in the past decade. In the last few years, the wireless industry has witnessed a strong trend towards disaggregated, virtualized and open RANs, with numerous tests and deployments worldwide. One unique aspect that motivates this paper is the availability of new opportunities that arise from using machine learning, more specifically multi-agent team learning (MATL), to optimize the RAN in a closed-loop where the complexity of disaggregation and virtualization makes well-known Self-Organized Networking (SON) solutions inadequate. In our view, Multi-Agent Systems (MASs) with MATL can play an essential role in the orchestration of O-RAN controllers, i.e., near-real-time and non-real-time RAN Intelligent Controllers (RIC). In this article, we first provide an overview of the landscape in RAN disaggregation, virtualization and O-RAN, then we present the state-of-the-art research in multi-agent systems and team learning as well as their application to O-RAN. We present a case study for team learning where agents are two distinct xApps: power allocation and radio resource allocation. We demonstrate how team learning can enhance network performance when team learning is used instead of individual learning agents. Finally, we identify challenges and open issues to provide a roadmap for researchers in the area of MATL based O-RAN optimization.

Team Learning-Based Resource Allocation for Open Radio Access Network (O-RAN)

Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing

Multi-Agent Team Learning in Virtualized Open Radio Access Networks (O-RAN)

Semi-Supervised Learning Approach for Efficient Resource Allocation with Network Slicing in O-RAN

User Access Control in Open Radio Access Networks: A Federated Deep Reinforcement Learning Approach

Multi Agent Team Learning in Disaggregated Virtualized Open Radio Access Networks (O-RAN)

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Machine Learning-based xApp for Dynamic Resource Allocation in O-RAN Networks

Radio Resource Management for Intelligent Neutral Host (INH) in Multi-Operator Environments

A Distributed User Association Method for LTE-U by Enabling Q-Learning in Minority Game.

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Adaptive Resource Allocation for Virtualized Base Stations in O-RAN with Online Learning

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Actor-Critic Network for O-RAN Resource Allocation: xApp Design, Deployment, and Analysis

Sparsity-Aware Intelligent Massive Random Access Control in Open RAN: A Reinforcement Learning Based Approach

Federated Deep Reinforcement Learning for User Access Control in Open Radio Access Networks

Intent-driven Intelligent Control and Orchestration in O-RAN Via Hierarchical Reinforcement Learning

Meta Reinforcement Learning Approach for Adaptive Resource Optimization in O-RAN

Q-Learning Based Joint Allocation of Fronthaul and Radio Resources in Multiwavelength-Enabled C-RAN

Deep Reinforcement Learning for Radio Resource Allocation in NOMA-based Remote State Estimation

A Decentralized Pilot Assignment Algorithm for Scalable O-RAN Cell-Free Massive MIMO