Abstract:Open Radio Access Network (O-RAN) alliance was recently launched to devise a new RAN architecture featuring open, software-driven, virtual, and intelligent radio access architecture. O-RAN architecture is based on (1) disaggregated RAN functions that run as Virtual Network Function (VNF) and Physical Network Function (PNF); (2) the notion of RAN controller that runs centrally RAN applications such as mobility management, users’ scheduling, radio resources allocation, etc. The RAN controller is in charge of enforcing the application decisions by using open interfaces with the RAN functions. One important feature introduced by O-RAN is the heavy usage of Machine Learning (ML) techniques, particularly Deep Learning (DL), to foster innovation and ease the deployment of intelligent RAN applications that are able to fulfill the Quality of Service (QoS) requirements of the envisioned 5G and beyond network services. In this work, we first give an overview of the evolution of RAN architectures toward 5G and beyond, namely C-RAN, vRAN, and O-RAN. We also compare them based on various perspectives, such as edge support, virtualization, control and management, energy consumption, and AI support. Then, we review existing DL-based solutions addressing the RAN part. We also show how they can be integrated/mapped to the O-RAN architecture since these works were not initially adapted to the O-RAN architecture. In addition, we present two case studies for DL techniques deployment in O-RAN. Furthermore, we describe how the main steps of deployed DL models in O-RAN can be automated, to ensure stable performance of these models, introducing ML system operations (MLOps) concept in O-RAN. Finally, we identify key technical challenges, open issues, and future research directions related to the Artificial Intelligence (AI)-enabled O-RAN architecture.

Machine Learning-enabled Traffic Steering in O-RAN: A Case Study on Hierarchical Learning Approach

Intelligent O-RAN Traffic Steering for URLLC Through Deep Reinforcement Learning

Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments

Traffic Steering for 5G Multi-RAT Deployments using Deep Reinforcement Learning

On Deep Reinforcement Learning for Traffic Steering Intelligent ORAN

Intelligent Traffic Steering in Beyond 5G Open RAN based on LSTM Traffic Prediction

Toward Scalable and Efficient Hierarchical Deep Reinforcement Learning for 5G RAN Slicing

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

CaRL: Cascade Reinforcement Learning with State Space Splitting for O-RAN based Traffic Steering

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Intent-driven Intelligent Control and Orchestration in O-RAN Via Hierarchical Reinforcement Learning

Federated Deep Reinforcement Learning for User Access Control in Open Radio Access Networks

Deep reinforcement learning for RAN optimization and control

User Access Control in Open Radio Access Networks: A Federated Deep Reinforcement Learning Approach

Deep Learning for B5G Open Radio Access Network: Evolution, Survey, Case Studies, and Challenges

Leveraging Deep Reinforcement Learning for Traffic Engineering: A Survey

Handover Control in Wireless Systems via Asynchronous Multi-User Deep Reinforcement Learning

Safe and Accelerated Deep Reinforcement Learning-based O-RAN Slicing: A Hybrid Transfer Learning Approach

Traffic Prediction and Random Access Control Optimization: Learning and Non-Learning-Based Approaches

Learning-assisted User Scheduling and Beamforming for mmWave Vehicular Networks

On-Device Intelligence for 5G RAN: Knowledge Transfer and Federated Learning enabled UE-Centric Traffic Steering